Sep 11 21:16:20 devstack cinder-volume[76437]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 21:16:20 devstack cinder-volume[76437]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 21:16:20 devstack cinder-volume[76437]: we strongly recommend against using it for new projects. Sep 11 21:16:20 devstack cinder-volume[76437]: If you are already using Eventlet, we recommend migrating to a different Sep 11 21:16:20 devstack cinder-volume[76437]: framework. For more detail see Sep 11 21:16:20 devstack cinder-volume[76437]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 21:16:20 devstack cinder-volume[76437]: import eventlet # noqa Sep 11 21:16:22 devstack cinder-volume[76437]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76437) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 21:16:22 devstack cinder-volume[76437]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76437) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 21:16:22 devstack cinder-volume[76437]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76437) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 21:16:23 devstack cinder-volume[76437]: INFO dbcounter [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Registered counter for database cinder Sep 11 21:16:23 devstack cinder-volume[76437]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76437) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG dbcounter [-] [76437] Writer thread running {{(pid=76437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 21:16:24 devstack cinder-volume[76437]: INFO cinder.rpc [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 21:16:24 devstack cinder-volume[76437]: INFO cinder.rpc [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76437) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:16:24 devstack cinder-volume[76437]: INFO cinder.volume.manager [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Determined volume DB was empty at startup. Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG cinder.volume.manager [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76437) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 21:16:24 devstack cinder-volume[76437]: INFO cinder.volume.manager [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 11 21:16:24 devstack cinder-volume[76437]: WARNING stevedore.named [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 21:16:24 devstack cinder-volume[76437]: WARNING castellan.key_manager [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 21:16:24 devstack cinder-volume[76437]: WARNING cinder.keymgr.conf_key_mgr [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG cinder.volume.drivers.lvm [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76437) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_concurrency.processutils [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_concurrency.processutils [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.415s {{(pid=76437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76437) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:16:24 devstack cinder-volume[76437]: INFO cinder.rpc [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 11 21:16:24 devstack cinder-volume[76437]: INFO cinder.rpc [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 11 21:16:24 devstack cinder-volume[76437]: WARNING stevedore.named [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 21:16:24 devstack cinder-volume[76437]: WARNING castellan.key_manager [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 21:16:24 devstack cinder-volume[76437]: INFO cinder.volume.manager [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76437) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:16:24 devstack cinder-volume[76437]: INFO oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Starting 1 workers Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Started child 76584 {{(pid=76437) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Full set of CONF: {{(pid=76437) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] ******************************************************************************** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Configuration options gathered from: {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] ================================================================================ {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] allow_availability_zone_fallback = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] allow_compression_on_image_upload = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] allowed_direct_url_schemes = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] api_rate_limit = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] auth_strategy = keystone {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] az_cache_duration = 3600 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_availability_zone = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_host = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_stats_polling_interval = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backup_api_class = cinder.backup.api.API {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backup_name_template = backup-%s {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backup_use_same_host = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backup_use_temp_snapshot = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] chap_password = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] chap_username = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cinder_internal_tenant_project_id = 2d2aabbf803b43b8a227a6904dc87592 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cinder_internal_tenant_user_id = 2aa185e4d18a4f1a91b599926445d4b5 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cloned_volume_same_az = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cluster = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] compression_format = gzip {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] compute_api_class = cinder.compute.nova.API {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] config_dir = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76584]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] config_source = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] control_exchange = openstack {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] debug = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] default_availability_zone = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] default_group_type = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] default_volume_type = lvmdriver-1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] disk_geometry = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] driver_client_cert = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] driver_client_cert_key = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] driver_data_namespace = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] driver_ssl_cert_path = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] driver_ssl_cert_verify = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] driver_use_ssl = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] enable_force_upload = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] enable_new_services = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] enable_unsupported_driver = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] enforce_multipath_for_image_xfer = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] filter_function = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_api_insecure = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_api_servers = ['http://192.168.122.57/image'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_api_ssl_compression = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_ca_certificates_file = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_catalog_info = image:glance:publicURL {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_certfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:24 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_keyfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_num_retries = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance_request_timeout = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] goodness_function = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] graceful_shutdown_timeout = 5 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] group_api_class = cinder.group.api.API {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] host = devstack {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_compress_on_upload = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_conversion_address_space_limit = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_conversion_cpu_limit = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_conversion_disable = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_introspection_address_space_limit = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_introspection_cpu_limit = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_upload_use_cinder_backend = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_upload_use_internal_tenant = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_volume_cache_enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_volume_cache_max_count = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] image_volume_cache_max_size_gb = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] init_host_max_objects_retrieval = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] instance_format = [instance: %(uuid)s] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] iscsi_target_flags = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] iscsi_write_cache = on {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] iser_helper = tgtadm {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] iser_ip_address = 192.168.122.57 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] iser_port = 3260 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] log_color = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] log_config_append = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] log_dir = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] log_file = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] log_options = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] log_rotate_interval = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] log_rotate_interval_type = days {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] log_rotation_type = none {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] max_age = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] max_logfile_count = 30 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] max_logfile_size_mb = 200 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] max_over_subscription_ratio = 20.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] message_reap_interval = 86400 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] message_ttl = 2592000 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] migration_create_volume_timeout_secs = 300 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] monkey_patch = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] monkey_patch_modules = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] my_ip = 192.168.122.57 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] no_snapshot_gb_quota = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] num_iser_scan_tries = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] num_shell_tries = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] num_volume_device_scan_tries = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] nvmeof_conn_info_version = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] nvmet_ns_id = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] nvmet_port_id = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] osapi_max_limit = 1000 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] osapi_volume_ext_list = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] osapi_volume_listen_port = 8776 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] osapi_volume_use_ssl = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] osapi_volume_workers = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] per_volume_size_limit = -1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] periodic_fuzzy_delay = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] periodic_interval = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] public_endpoint = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] publish_errors = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] quota_backup_gigabytes = 1000 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] quota_backups = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] quota_gigabytes = 1000 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] quota_groups = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] quota_snapshots = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] quota_volumes = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] rate_limit_burst = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] rate_limit_except_level = CRITICAL {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] rate_limit_interval = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] reinit_driver_count = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] replication_device = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] report_discard_supported = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] report_interval = 120 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] reservation_clean_interval = 86400 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] reservation_expire = 86400 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] reserved_image_namespaces = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] reserved_percentage = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] rpc_response_timeout = 120 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] run_external_periodic_tasks = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] scst_target_driver = iscsi {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] scst_target_iqn_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_down_time = 720 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] shell_completion = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] snapshot_name_template = snapshot-%s {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] snapshot_same_host = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] split_loggers = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] state_path = /opt/stack/data/cinder {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] storage_availability_zone = nova {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] storage_protocol = iSCSI {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] syslog_log_facility = LOG_USER {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] target_helper = lioadm {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] target_ip_address = 192.168.122.57 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] target_port = 3260 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] target_protocol = iscsi {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] target_secondary_ip_addresses = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] trace_flags = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] transport_url = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] until_refresh = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] use_chap_auth = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] use_default_quota_class = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] use_journal = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] use_json = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] use_multipath_for_image_xfer = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76584]: INFO cinder.volume.manager [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] use_stderr = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] use_syslog = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] verify_glance_signatures = enabled {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_api_class = cinder.volume.api.API {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_backend_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_clear = zero {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_clear_ionice = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_clear_size = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_copy_bps_limit = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_dd_blocksize = 1M {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_name_template = volume-%s {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_service_inithost_offload = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volume_usage_audit_period = month {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] zoning_mode = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_concurrency.disable_process_locking = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.auth_section = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.auth_type = password {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.auth_version = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.cache = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.certfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.include_service_catalog = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.insecure = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.interface = public {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.keyfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_password = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcache_username = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.region_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.service_type = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.57/identity {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.backend = dogpile.cache.null {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.backend_argument = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.backend_expiration_time = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.config_prefix = cache.oslo {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.debug_cache_backend = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.enable_retry_client = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.enable_socket_keepalive = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.expiration_time = 600 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.hashclient_retry_attempts = 2 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.memcache_dead_retry = 300 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.memcache_pool_maxsize = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.memcache_sasl_enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.password = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.proxies = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.redis_db = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.redis_server = localhost:6379 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.retry_attempts = 2 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.retry_delay = 0.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.socket_keepalive_count = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.socket_keepalive_idle = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.socket_keepalive_interval = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.socket_timeout = 1.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.tls_allowed_ciphers = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.tls_cafile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.tls_certfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.tls_enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.tls_keyfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cache.username = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] coordination.backend_url = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.asyncio_connection = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.asyncio_slave_connection = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.backend = sqlalchemy {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.connection = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.connection_debug = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.connection_parameters = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.connection_recycle_time = 3600 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.connection_trace = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.db_inc_retry_interval = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.db_max_retries = 20 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.db_max_retry_interval = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.db_retry_interval = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.max_overflow = 50 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.max_pool_size = 5 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.max_retries = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.mysql_wsrep_sync_wait = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.pool_timeout = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.retry_interval = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.slave_connection = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.sqlite_synchronous = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.synchronous_reader = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] database.use_db_reconnect = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_tracing.insecure = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.connection_string = messaging:// {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.es_doc_type = notification {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.es_scroll_size = 10000 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.es_scroll_time = 2m {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.filter_error_trace = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.hmac_keys = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.sentinel_service_name = mymaster {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.socket_timeout = 0.1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.trace_requests = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler.trace_sqlalchemy = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler_jaeger.process_tags = {} {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler_jaeger.service_name_prefix = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] profiler_otlp.service_name_prefix = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.enforce_new_defaults = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.policy_default_rule = default {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.policy_file = policy.yaml {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] privsep_osbrick.group = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] privsep_osbrick.helper_command = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] privsep_osbrick.user = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cinder_sys_admin.group = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cinder_sys_admin.helper_command = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] cinder_sys_admin.user = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.auth_section = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.auth_type = password {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.cafile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.certfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.collect_timing = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.insecure = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.keyfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.send_service_user_token = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.split_loggers = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.timeout = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.tls_ciphers = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] service_user.tls_min_version = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.auth_section = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.auth_type = password {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.certfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.collect_timing = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.insecure = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.keyfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.region_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.split_loggers = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.timeout = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.tls_ciphers = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] glance.tls_min_version = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.backend_availability_zone = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.chap_password = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.chap_username = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.disk_geometry = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.driver_client_cert = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.driver_client_cert_key = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.driver_data_namespace = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.driver_use_ssl = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.extra_capabilities = {} {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.filter_function = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.goodness_function = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.iscsi_target_flags = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.iscsi_write_cache = on {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.iser_helper = tgtadm {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.iser_ip_address = 192.168.122.57 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.iser_port = 3260 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.lvm_share_target = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.lvm_type = auto {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack sudo[76588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.num_shell_tries = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.replication_device = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.report_discard_supported = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.reserved_percentage = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.target_helper = tgtadm {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.target_ip_address = 192.168.122.57 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.target_port = 3260 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.target_protocol = iscsi {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.trace_flags = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.unique_fqdn_network = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.use_chap_auth = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volume_backend_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volume_clear = zero {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volume_clear_ionice = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volume_clear_size = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_reports.file_event_handler = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_reports.log_dir = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.backend_host = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.chap_password = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.chap_username = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.disk_geometry = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.driver_client_cert = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.extra_capabilities = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.filter_function = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.goodness_function = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.iser_helper = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.iser_ip_address = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.iser_port = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.lvm_share_target = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.lvm_type = auto {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.num_shell_tries = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.replication_device = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.report_discard_supported = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.reserved_percentage = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.scst_target_driver = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.storage_protocol = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.target_helper = lioadm {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.target_ip_address = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.target_port = 3260 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.trace_flags = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.065s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.use_chap_auth = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volume_clear = zero {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volume_clear_size = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] lvmdriver-1.volumes_dir = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.ssl = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_notifications.driver = [] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_notifications.retry = -1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] key_manager.fixed_key = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.barbican_api_version = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.barbican_endpoint = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.barbican_endpoint_type = public {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.barbican_region_name = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.cafile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.certfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.collect_timing = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.insecure = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.keyfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.number_of_retries = 60 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.retry_delay = 1 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.send_service_user_token = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.split_loggers = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.timeout = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.tls_ciphers = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.tls_min_version = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.verify_ssl = True {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican.verify_ssl_path = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.auth_section = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.auth_type = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.cafile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.certfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.collect_timing = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.insecure = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.keyfile = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.split_loggers = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.timeout = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.tls_ciphers = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] barbican_service_user.tls_min_version = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.approle_role_id = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.approle_secret_id = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.auth_method = approle {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.auth_path = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.kv_mountpoint = secret {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.kv_path = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.kv_version = 2 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.namespace = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.root_token_id = **** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.ssl_ca_crt_file = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.timeout = 60.0 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.token_file = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.token_role = None {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.use_ssl = False {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:16:25 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] ******************************************************************************** {{(pid=76437) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 21:16:25 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:25 devstack sudo[76593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:16:25 devstack sudo[76593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:25 devstack sudo[76593]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.370s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:16:25 devstack cinder-volume[76584]: INFO cinder.brick.local_dev.lvm [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:25 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:26 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 21:16:26 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:26 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:26 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:26 devstack cinder-volume[76584]: DEBUG cinder.brick.local_dev.lvm [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76584) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 11 21:16:26 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:26 devstack sudo[76821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:16:26 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:26 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:26 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.532s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:26 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:26 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:26 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:26 devstack sudo[77016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:16:26 devstack sudo[77016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:27 devstack sudo[77016]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:27 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:27 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:27 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:27 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:27 devstack sudo[77112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 11 21:16:27 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:27 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:27 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.291s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:27 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:27 devstack sudo[77203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 21:16:27 devstack sudo[77203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:27 devstack sudo[77203]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:27 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:27 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:27 devstack sudo[77206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 21:16:27 devstack sudo[77206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:28 devstack sudo[77206]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:28 devstack sudo[77290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:16:28 devstack sudo[77290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:28 devstack sudo[77290]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:28 devstack sudo[77293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:16:28 devstack sudo[77293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:28 devstack sudo[77293]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:28 devstack sudo[77326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:16:28 devstack sudo[77326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:28 devstack sudo[77326]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:28 devstack cinder-volume[76584]: INFO cinder.volume.drivers.lvm [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:28 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:28 devstack sudo[77387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:16:28 devstack sudo[77387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:29 devstack sudo[77387]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:29 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:29 devstack cinder-volume[76584]: DEBUG cinder.volume.drivers.lvm [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Updating volume stats {{(pid=76584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 21:16:29 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:29 devstack sudo[77390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 21:16:29 devstack sudo[77390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:29 devstack sudo[77390]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:29 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:29 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:29 devstack sudo[77393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:16:29 devstack sudo[77393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:29 devstack sudo[77393]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:29 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:29 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:29 devstack sudo[77404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:16:29 devstack sudo[77404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:30 devstack sudo[77404]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:30 devstack sudo[77407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:16:30 devstack sudo[77407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:30 devstack sudo[77407]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:30 devstack cinder-volume[76584]: INFO cinder.volume.driver [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Driver hasn't implemented _init_vendor_properties() Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG cinder.volume.driver [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76584) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG oslo_db.sqlalchemy.engines [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76584) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG dbcounter [-] [76584] Writer thread running {{(pid=76584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG cinder.db.api [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Building query based on filter {{(pid=76584) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG cinder.image.image_utils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76584) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 11 21:16:30 devstack cinder-volume[76584]: INFO cinder.keymgr.migration [None req-dbe63ab0-a70b-4284-b791-44becbdfda8a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG cinder.volume.drivers.lvm [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Updating volume stats {{(pid=76584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:30 devstack sudo[77411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 21:16:30 devstack sudo[77411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:30 devstack sudo[77411]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:30 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:30 devstack sudo[77414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:16:30 devstack sudo[77414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:31 devstack sudo[77414]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:31 devstack sudo[77419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:16:31 devstack sudo[77419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:31 devstack sudo[77419]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:31 devstack sudo[77424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:16:31 devstack sudo[77424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:31 devstack sudo[77424]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG cinder.manager [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Notifying Schedulers of capabilities ... {{(pid=76584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:16:31 devstack cinder-volume[76584]: INFO cinder.volume.manager [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Driver initialization completed successfully. Sep 11 21:16:31 devstack cinder-volume[76584]: INFO cinder.manager [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Initiating service 2 cleanup Sep 11 21:16:31 devstack cinder-volume[76584]: INFO cinder.manager [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Service 2 cleanup completed. Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG cinder.service [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Creating RPC server for service cinder-volume {{(pid=76584) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG cinder.service [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76584) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 21:16:31 devstack cinder-volume[76584]: INFO cinder.volume.manager [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG cinder.volume.drivers.lvm [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Updating volume stats {{(pid=76584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 21:16:31 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:31 devstack sudo[77427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 21:16:31 devstack sudo[77427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:32 devstack sudo[77427]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:32 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:32 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:32 devstack sudo[77431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:16:32 devstack sudo[77431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:32 devstack sudo[77431]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:32 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:32 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:32 devstack sudo[77435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:16:32 devstack sudo[77435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:32 devstack sudo[77435]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:32 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:32 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:16:32 devstack sudo[77438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:16:32 devstack sudo[77438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:16:32 devstack sudo[77438]: pam_unix(sudo:session): session closed for user root Sep 11 21:16:32 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:16:32 devstack cinder-volume[76584]: INFO cinder.volume.manager [None req-614e6ae0-3f50-4f97-8463-558647b69d4e None None] Driver post RPC initialization completed successfully. Sep 11 21:16:34 devstack cinder-volume[76437]: DEBUG dbcounter [-] [76437] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:16:41 devstack cinder-volume[76584]: DEBUG dbcounter [-] [76584] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:16:42 devstack cinder-volume[76584]: DEBUG dbcounter [-] [76584] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:16:55 devstack cinder-volume[76584]: DEBUG oslo_service.periodic_task [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=76584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:16:55 devstack cinder-volume[76584]: DEBUG cinder.volume.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] thread count: 6 {{(pid=76584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:16:55 devstack cinder-volume[76584]: DEBUG cinder.volume.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] thread info: [<_MainThread(MainThread, started 123776190673024)>, , , , , ] {{(pid=76584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:17:55 devstack cinder-volume[76584]: DEBUG oslo_service.periodic_task [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:17:55 devstack cinder-volume[76584]: DEBUG cinder.volume.drivers.lvm [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Updating volume stats {{(pid=76584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 21:17:55 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:17:55 devstack sudo[80085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 21:17:55 devstack sudo[80085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:17:56 devstack sudo[80085]: pam_unix(sudo:session): session closed for user root Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:17:56 devstack sudo[80088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:17:56 devstack sudo[80088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:17:56 devstack sudo[80088]: pam_unix(sudo:session): session closed for user root Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:17:56 devstack sudo[80091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:17:56 devstack sudo[80091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:17:56 devstack sudo[80091]: pam_unix(sudo:session): session closed for user root Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:17:56 devstack sudo[80094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:17:56 devstack sudo[80094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:17:56 devstack sudo[80094]: pam_unix(sudo:session): session closed for user root Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG cinder.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Notifying Schedulers of capabilities ... {{(pid=76584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG oslo_service.periodic_task [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=76584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG cinder.volume.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] thread count: 6 {{(pid=76584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:17:56 devstack cinder-volume[76584]: DEBUG cinder.volume.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] thread info: [<_MainThread(MainThread, started 123776190673024)>, , , , , ] {{(pid=76584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:18:42 devstack cinder-volume[76584]: DEBUG dbcounter [-] [76584] Writing DB stats cinder:SELECT=1 {{(pid=76584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:18:42 devstack cinder-volume[76584]: DEBUG dbcounter [-] [76584] Writing DB stats cinder:UPDATE=1 {{(pid=76584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:18:55 devstack cinder-volume[76584]: DEBUG oslo_service.periodic_task [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:18:55 devstack cinder-volume[76584]: DEBUG cinder.volume.drivers.lvm [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Updating volume stats {{(pid=76584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 21:18:55 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:18:55 devstack sudo[83349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 21:18:55 devstack sudo[83349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:18:56 devstack sudo[83349]: pam_unix(sudo:session): session closed for user root Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:18:56 devstack sudo[83434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:18:56 devstack sudo[83434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:18:56 devstack sudo[83434]: pam_unix(sudo:session): session closed for user root Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:18:56 devstack sudo[83629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:18:56 devstack sudo[83629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:18:56 devstack sudo[83629]: pam_unix(sudo:session): session closed for user root Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:18:56 devstack sudo[83707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:18:56 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:18:56 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG cinder.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Notifying Schedulers of capabilities ... {{(pid=76584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG oslo_service.periodic_task [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=76584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG cinder.volume.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] thread count: 6 {{(pid=76584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:18:56 devstack cinder-volume[76584]: DEBUG cinder.volume.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] thread info: [<_MainThread(MainThread, started 123776190673024)>, , , , , ] {{(pid=76584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:19:55 devstack cinder-volume[76584]: DEBUG oslo_service.periodic_task [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:19:55 devstack cinder-volume[76584]: DEBUG cinder.volume.drivers.lvm [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Updating volume stats {{(pid=76584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 21:19:55 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:19:55 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 21:19:55 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:19:56 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:19:56 devstack sudo[85475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:19:56 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:19:56 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:19:56 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 21:19:56 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:19:56 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:19:56 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 21:19:56 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:19:56 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG oslo_concurrency.processutils [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG cinder.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Notifying Schedulers of capabilities ... {{(pid=76584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG oslo_service.periodic_task [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] Running periodic task VolumeManager._thread_info {{(pid=76584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG cinder.volume.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] thread count: 6 {{(pid=76584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:19:56 devstack cinder-volume[76584]: DEBUG cinder.volume.manager [None req-3fff39b8-4f13-42af-baa6-a47f17393cd7 None None] thread info: [<_MainThread(MainThread, started 123776190673024)>, , , , , ] {{(pid=76584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:20:42 devstack cinder-volume[76584]: DEBUG dbcounter [-] [76584] Writing DB stats cinder:SELECT=1 {{(pid=76584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:20:42 devstack cinder-volume[76584]: DEBUG dbcounter [-] [76584] Writing DB stats cinder:UPDATE=1 {{(pid=76584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:20:46 devstack cinder-volume[76437]: INFO oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Caught SIGTERM, stopping children Sep 11 21:20:46 devstack cinder-volume[76437]: DEBUG oslo_concurrency.lockutils [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Acquiring lock "singleton_lock" {{(pid=76437) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 21:20:46 devstack cinder-volume[76437]: DEBUG oslo_concurrency.lockutils [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Acquired lock "singleton_lock" {{(pid=76437) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 21:20:46 devstack cinder-volume[76437]: DEBUG oslo_concurrency.lockutils [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Releasing lock "singleton_lock" {{(pid=76437) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 21:20:46 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Stop services. {{(pid=76437) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 11 21:20:46 devstack cinder-volume[76437]: DEBUG oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Killing children. {{(pid=76437) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 11 21:20:46 devstack cinder-volume[76437]: INFO oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Waiting on 1 children to exit Sep 11 21:20:46 devstack cinder-volume[76584]: DEBUG oslo_concurrency.lockutils [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Acquiring lock "singleton_lock" {{(pid=76584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 21:20:46 devstack cinder-volume[76584]: DEBUG oslo_concurrency.lockutils [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Acquired lock "singleton_lock" {{(pid=76584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 21:20:46 devstack cinder-volume[76584]: DEBUG oslo_concurrency.lockutils [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Releasing lock "singleton_lock" {{(pid=76584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 21:20:46 devstack cinder-volume[76584]: WARNING amqp [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 21:20:46 devstack cinder-volume[76584]: WARNING amqp [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 21:20:46 devstack cinder-volume[76437]: INFO oslo_service.backend._eventlet.service [None req-b6b8d22e-e6ce-4cf7-8055-894c49a73db4 None None] Child 76584 exited with status 0 Sep 11 21:20:47 devstack cinder-volume[86576]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 21:20:47 devstack cinder-volume[86576]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 21:20:47 devstack cinder-volume[86576]: we strongly recommend against using it for new projects. Sep 11 21:20:47 devstack cinder-volume[86576]: If you are already using Eventlet, we recommend migrating to a different Sep 11 21:20:47 devstack cinder-volume[86576]: framework. For more detail see Sep 11 21:20:47 devstack cinder-volume[86576]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 21:20:47 devstack cinder-volume[86576]: import eventlet # noqa Sep 11 21:20:49 devstack cinder-volume[86576]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 21:20:49 devstack cinder-volume[86576]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 21:20:49 devstack cinder-volume[86576]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 21:20:49 devstack cinder-volume[86576]: INFO dbcounter [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Registered counter for database cinder Sep 11 21:20:49 devstack cinder-volume[86576]: DEBUG oslo_db.sqlalchemy.engines [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG dbcounter [-] [86576] Writer thread running {{(pid=86576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 21:20:50 devstack cinder-volume[86576]: INFO cinder.rpc [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 21:20:50 devstack cinder-volume[86576]: INFO cinder.rpc [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_db.sqlalchemy.engines [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:20:50 devstack cinder-volume[86576]: INFO cinder.volume.manager [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Determined volume DB was empty at startup. Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG cinder.volume.manager [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86576) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 21:20:50 devstack cinder-volume[86576]: INFO cinder.volume.manager [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 11 21:20:50 devstack cinder-volume[86576]: WARNING stevedore.named [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 21:20:50 devstack cinder-volume[86576]: WARNING castellan.key_manager [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 21:20:50 devstack cinder-volume[86576]: WARNING cinder.keymgr.conf_key_mgr [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 21:20:50 devstack cinder-volume[86576]: INFO cinder.volume.manager [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_db.sqlalchemy.engines [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:20:50 devstack cinder-volume[86576]: INFO oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Starting 1 workers Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Started child 86790 {{(pid=86576) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Full set of CONF: {{(pid=86576) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] ******************************************************************************** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Configuration options gathered from: {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] ================================================================================ {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] allow_availability_zone_fallback = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] allow_compression_on_image_upload = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] allowed_direct_url_schemes = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] api_rate_limit = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] auth_strategy = keystone {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_availability_zone = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_host = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_stats_polling_interval = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backup_api_class = cinder.backup.api.API {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backup_name_template = backup-%s {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backup_use_same_host = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backup_use_temp_snapshot = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] chap_password = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] chap_username = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cinder_internal_tenant_project_id = 2d2aabbf803b43b8a227a6904dc87592 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cinder_internal_tenant_user_id = 2aa185e4d18a4f1a91b599926445d4b5 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cluster = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] compression_format = gzip {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] compute_api_class = cinder.compute.nova.API {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] config_dir = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] config_source = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] control_exchange = openstack {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] debug = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] default_availability_zone = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] default_group_type = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] default_volume_type = QuobyteHD {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] disk_geometry = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] driver_client_cert = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] driver_client_cert_key = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] driver_data_namespace = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] driver_ssl_cert_path = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] driver_ssl_cert_verify = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] driver_use_ssl = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] enable_new_services = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] enable_unsupported_driver = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] enabled_backends = ['QuobyteHD'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86790]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] enforce_multipath_for_image_xfer = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] filter_function = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_api_insecure = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_api_servers = ['http://192.168.122.57/image'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_api_ssl_compression = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_ca_certificates_file = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_catalog_info = image:glance:publicURL {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_certfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_keyfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_num_retries = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance_request_timeout = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] goodness_function = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] graceful_shutdown_timeout = 5 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] group_api_class = cinder.group.api.API {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] host = devstack {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_compress_on_upload = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_conversion_address_space_limit = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_conversion_cpu_limit = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_conversion_disable = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_introspection_address_space_limit = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_introspection_cpu_limit = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_upload_use_cinder_backend = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_upload_use_internal_tenant = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_volume_cache_enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_volume_cache_max_count = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] image_volume_cache_max_size_gb = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] init_host_max_objects_retrieval = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] instance_format = [instance: %(uuid)s] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] iscsi_target_flags = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] iscsi_write_cache = on {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] iser_helper = tgtadm {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] iser_ip_address = 192.168.122.57 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] iser_port = 3260 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] log_color = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] log_config_append = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] log_dir = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] log_file = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] log_options = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] log_rotate_interval = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] log_rotate_interval_type = days {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] log_rotation_type = none {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] max_age = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] max_logfile_count = 30 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] max_logfile_size_mb = 200 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] max_over_subscription_ratio = 20.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] message_reap_interval = 86400 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] message_ttl = 2592000 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] migration_create_volume_timeout_secs = 300 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] monkey_patch = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] monkey_patch_modules = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] my_ip = 192.168.122.57 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] no_snapshot_gb_quota = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] num_iser_scan_tries = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] num_shell_tries = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] num_volume_device_scan_tries = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] nvmeof_conn_info_version = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] nvmet_ns_id = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] nvmet_port_id = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] osapi_max_limit = 1000 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] osapi_volume_ext_list = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] osapi_volume_listen_port = 8776 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] osapi_volume_use_ssl = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] osapi_volume_workers = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] per_volume_size_limit = -1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] periodic_fuzzy_delay = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] periodic_interval = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] public_endpoint = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] publish_errors = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] quota_backup_gigabytes = 1000 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] quota_backups = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] quota_gigabytes = 1000 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] quota_groups = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] quota_snapshots = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] quota_volumes = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] rate_limit_burst = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] rate_limit_except_level = CRITICAL {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] rate_limit_interval = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] reinit_driver_count = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] replication_device = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] report_discard_supported = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] report_interval = 120 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] reservation_clean_interval = 86400 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] reservation_expire = 86400 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] reserved_image_namespaces = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] reserved_percentage = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] rpc_response_timeout = 120 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] run_external_periodic_tasks = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] scst_target_driver = iscsi {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] scst_target_iqn_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_down_time = 720 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] shell_completion = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] snapshot_name_template = snapshot-%s {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] split_loggers = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] state_path = /opt/stack/data/cinder {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] storage_availability_zone = nova {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] storage_protocol = iSCSI {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] syslog_log_facility = LOG_USER {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] target_helper = lioadm {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] target_ip_address = 192.168.122.57 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] target_port = 3260 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] target_protocol = iscsi {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] target_secondary_ip_addresses = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] trace_flags = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] transport_url = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] until_refresh = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] use_chap_auth = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] use_default_quota_class = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] use_journal = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] use_json = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] use_multipath_for_image_xfer = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] use_stderr = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] use_syslog = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] verify_glance_signatures = enabled {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_api_class = cinder.volume.api.API {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_backend_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_clear = zero {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_clear_ionice = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_clear_size = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_copy_bps_limit = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_dd_blocksize = 1M {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86790]: INFO cinder.volume.manager [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 11 21:20:50 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.remotefs [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86790) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_name_template = volume-%s {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_service_inithost_offload = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volume_usage_audit_period = month {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] zoning_mode = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_concurrency.disable_process_locking = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.auth_section = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.auth_type = password {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.auth_version = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.cache = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.certfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.include_service_catalog = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.insecure = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.interface = public {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.keyfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_password = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcache_username = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.region_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.service_type = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.57/identity {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.backend = dogpile.cache.null {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.backend_argument = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.backend_expiration_time = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.config_prefix = cache.oslo {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.debug_cache_backend = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.enable_retry_client = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.enable_socket_keepalive = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.expiration_time = 600 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.hashclient_retry_attempts = 2 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.memcache_dead_retry = 300 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.memcache_pool_maxsize = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.memcache_sasl_enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.password = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.proxies = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.redis_db = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.redis_server = localhost:6379 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.retry_attempts = 2 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.retry_delay = 0.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.socket_keepalive_count = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.socket_keepalive_idle = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.socket_keepalive_interval = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.socket_timeout = 1.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.tls_allowed_ciphers = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.tls_cafile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.tls_certfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.tls_enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.tls_keyfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cache.username = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] coordination.backend_url = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.asyncio_connection = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.asyncio_slave_connection = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.backend = sqlalchemy {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.connection = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.connection_debug = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.connection_parameters = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.connection_recycle_time = 3600 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.connection_trace = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.db_inc_retry_interval = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.db_max_retries = 20 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.db_max_retry_interval = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.db_retry_interval = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.max_overflow = 50 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.max_pool_size = 5 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.max_retries = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.mysql_wsrep_sync_wait = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.pool_timeout = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.retry_interval = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.slave_connection = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.sqlite_synchronous = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.synchronous_reader = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] database.use_db_reconnect = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_tracing.insecure = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.connection_string = messaging:// {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.es_doc_type = notification {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.es_scroll_size = 10000 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.es_scroll_time = 2m {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.filter_error_trace = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.hmac_keys = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.sentinel_service_name = mymaster {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.socket_timeout = 0.1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.trace_requests = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler.trace_sqlalchemy = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler_jaeger.process_tags = {} {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler_jaeger.service_name_prefix = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] profiler_otlp.service_name_prefix = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.enforce_new_defaults = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.policy_default_rule = default {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.policy_file = policy.yaml {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] privsep_osbrick.group = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] privsep_osbrick.helper_command = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86790) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 11 21:20:50 devstack cinder-volume[86790]: WARNING cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 11 21:20:50 devstack cinder-volume[86790]: WARNING cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 11 21:20:50 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Running cmd (subprocess): mount.quobyte {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] privsep_osbrick.user = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cinder_sys_admin.group = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cinder_sys_admin.helper_command = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] cinder_sys_admin.user = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.auth_section = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.auth_type = password {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.cafile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.certfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.collect_timing = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.insecure = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.keyfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.send_service_user_token = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.split_loggers = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.timeout = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.tls_ciphers = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] service_user.tls_min_version = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.auth_section = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.auth_type = password {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.certfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.collect_timing = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.insecure = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.keyfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.region_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.split_loggers = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.timeout = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.tls_ciphers = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] glance.tls_min_version = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.backend_availability_zone = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.chap_password = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.chap_username = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.disk_geometry = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.driver_client_cert = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.driver_client_cert_key = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.driver_data_namespace = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.driver_use_ssl = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.extra_capabilities = {} {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.filter_function = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.goodness_function = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.iscsi_target_flags = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.iscsi_write_cache = on {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.iser_helper = tgtadm {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.iser_ip_address = 192.168.122.57 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.iser_port = 3260 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_host = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_login = admin {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_mount_options = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_password = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_private_key = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_share_path = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.num_shell_tries = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.quobyte_volume_url = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.replication_device = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.report_discard_supported = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.reserved_percentage = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.target_helper = tgtadm {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.target_ip_address = 192.168.122.57 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.target_port = 3260 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.target_protocol = iscsi {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.trace_flags = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.unique_fqdn_network = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.use_chap_auth = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.volume_backend_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.volume_clear = zero {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.volume_clear_ionice = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.volume_clear_size = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_reports.file_event_handler = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_reports.log_dir = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.backend_availability_zone = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.backend_host = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.chap_password = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.chap_username = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.chiscsi_conf = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.disk_geometry = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.driver_client_cert = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.driver_data_namespace = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.driver_use_ssl = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.extra_capabilities = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.filter_function = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.goodness_function = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.iser_helper = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.iser_ip_address = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.iser_port = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.iser_target_prefix = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_host = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_login = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_mount_options = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_password = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_private_key = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_share_path = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_ssh_port = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.num_shell_tries = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.nvmet_port_id = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.replication_device = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.report_discard_supported = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.reserved_percentage = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.scst_target_driver = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.storage_protocol = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.target_helper = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.target_ip_address = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.target_port = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.target_prefix = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.target_protocol = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.trace_flags = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack quobyte-client[86791]: Reading configuration file: /etc/quobyte/client.cfg Sep 11 21:20:50 devstack quobyte-client[86791]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.use_chap_auth = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.volume_clear = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.volume_clear_size = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] QuobyteHD.volumes_dir = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] CMD "mount.quobyte" returned: 1 in 0.127s {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:20:50 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:20:50 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=86790) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86790]: INFO cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 ... Sep 11 21:20:50 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b -c /etc/quobyte/client-cinder.cfg {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.ssl = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_notifications.driver = [] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_notifications.retry = -1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] key_manager.fixed_key = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.barbican_api_version = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.barbican_endpoint = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.barbican_endpoint_type = public {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.barbican_region_name = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.cafile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.certfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.collect_timing = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.insecure = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.keyfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.number_of_retries = 60 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.retry_delay = 1 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.send_service_user_token = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.split_loggers = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.timeout = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.tls_ciphers = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b -c /etc/quobyte/client-cinder.cfg Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.tls_min_version = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.verify_ssl = True {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican.verify_ssl_path = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.auth_section = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.auth_type = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.cafile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.certfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.collect_timing = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.insecure = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.keyfile = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.split_loggers = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.timeout = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.tls_ciphers = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] barbican_service_user.tls_min_version = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.approle_role_id = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.approle_secret_id = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.auth_method = approle {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.auth_path = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.kv_mountpoint = secret {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.kv_path = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.kv_version = 2 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.namespace = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.root_token_id = **** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.ssl_ca_crt_file = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.timeout = 60.0 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.token_file = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.token_role = None {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.use_ssl = False {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:20:50 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] ******************************************************************************** {{(pid=86576) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 21:20:51 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.370s {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:20:51 devstack cinder-volume[86790]: INFO cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 succeeded Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=86790) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.382s {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:20:51 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:20:51 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:20:51 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.233s {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:20:51 devstack cinder-volume[86790]: INFO cinder.volume.driver [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Driver hasn't implemented _init_vendor_properties() Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG cinder.volume.driver [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1959838867188, 'free_capacity_gb': 1773.1959838867188, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86790) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_db.sqlalchemy.engines [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86790) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG dbcounter [-] [86790] Writer thread running {{(pid=86790) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG cinder.db.api [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Building query based on filter {{(pid=86790) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG cinder.image.image_utils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86790) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 11 21:20:51 devstack cinder-volume[86790]: INFO cinder.keymgr.migration [None req-0ac9c010-e249-4cd9-8c9a-7f7323f083fd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=86790) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=86790) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:20:51 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:20:51 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:20:51 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.214s {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG cinder.manager [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Notifying Schedulers of capabilities ... {{(pid=86790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:20:51 devstack cinder-volume[86790]: INFO cinder.volume.manager [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Driver initialization completed successfully. Sep 11 21:20:51 devstack cinder-volume[86790]: INFO cinder.manager [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Initiating service 3 cleanup Sep 11 21:20:51 devstack cinder-volume[86790]: INFO cinder.manager [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Service 3 cleanup completed. Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG cinder.service [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Creating RPC server for service cinder-volume {{(pid=86790) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 21:20:51 devstack cinder-volume[86790]: DEBUG cinder.service [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86790) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 21:20:52 devstack cinder-volume[86790]: INFO cinder.volume.manager [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 11 21:20:52 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:20:52 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:20:52 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=86790) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:20:52 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=86790) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:20:52 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:20:52 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:20:52 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:20:52 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:20:52 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Sep 11 21:20:52 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.248s {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:20:52 devstack cinder-volume[86790]: INFO cinder.volume.manager [None req-dd0c6265-4b4e-4c86-8388-6e6e1c67c817 None None] Driver post RPC initialization completed successfully. Sep 11 21:20:57 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-517d0e88-0f58-4787-bde9-c817c22c86a3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:20:57 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-517d0e88-0f58-4787-bde9-c817c22c86a3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:20:57 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.quobyte [None req-517d0e88-0f58-4787-bde9-c817c22c86a3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=86790) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:20:57 devstack cinder-volume[86790]: DEBUG cinder.volume.drivers.quobyte [None req-517d0e88-0f58-4787-bde9-c817c22c86a3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=86790) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:20:57 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-517d0e88-0f58-4787-bde9-c817c22c86a3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86790) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:20:57 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-517d0e88-0f58-4787-bde9-c817c22c86a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:20:57 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:20:57 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:20:57 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Sep 11 21:20:57 devstack cinder-volume[86790]: DEBUG oslo_concurrency.processutils [None req-517d0e88-0f58-4787-bde9-c817c22c86a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.224s {{(pid=86790) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:20:57 devstack cinder-volume[86790]: DEBUG cinder.manager [None req-517d0e88-0f58-4787-bde9-c817c22c86a3 None None] Notifying Schedulers of capabilities ... {{(pid=86790) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:21:00 devstack cinder-volume[86576]: INFO oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Caught SIGTERM, stopping children Sep 11 21:21:00 devstack cinder-volume[86576]: DEBUG oslo_concurrency.lockutils [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Acquiring lock "singleton_lock" {{(pid=86576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 21:21:00 devstack cinder-volume[86576]: DEBUG oslo_concurrency.lockutils [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Acquired lock "singleton_lock" {{(pid=86576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 21:21:00 devstack cinder-volume[86576]: DEBUG oslo_concurrency.lockutils [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Releasing lock "singleton_lock" {{(pid=86576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 21:21:00 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Stop services. {{(pid=86576) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 11 21:21:00 devstack cinder-volume[86576]: DEBUG oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Killing children. {{(pid=86576) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 11 21:21:00 devstack cinder-volume[86576]: INFO oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Waiting on 1 children to exit Sep 11 21:21:01 devstack cinder-volume[86790]: DEBUG dbcounter [-] [86790] Writing DB stats cinder:SELECT=2 {{(pid=86790) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:21:02 devstack cinder-volume[86790]: DEBUG dbcounter [-] [86790] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86790) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:21:05 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Acquiring lock "singleton_lock" {{(pid=86790) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 21:21:05 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Acquired lock "singleton_lock" {{(pid=86790) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 21:21:05 devstack cinder-volume[86790]: DEBUG oslo_concurrency.lockutils [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Releasing lock "singleton_lock" {{(pid=86790) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 21:21:05 devstack cinder-volume[86790]: WARNING amqp [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 21:21:05 devstack cinder-volume[86790]: WARNING amqp [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 21:21:05 devstack cinder-volume[86576]: INFO oslo_service.backend._eventlet.service [None req-483ac6c4-e475-4a27-8c7a-7498487cf46f None None] Child 86790 exited with status 0 Sep 11 21:21:05 devstack cinder-volume[87096]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 21:21:05 devstack cinder-volume[87096]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 21:21:05 devstack cinder-volume[87096]: we strongly recommend against using it for new projects. Sep 11 21:21:05 devstack cinder-volume[87096]: If you are already using Eventlet, we recommend migrating to a different Sep 11 21:21:05 devstack cinder-volume[87096]: framework. For more detail see Sep 11 21:21:05 devstack cinder-volume[87096]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 21:21:05 devstack cinder-volume[87096]: import eventlet # noqa Sep 11 21:21:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87096) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 21:21:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87096) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 21:21:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87096) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 21:21:08 devstack cinder-volume[87096]: INFO dbcounter [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Registered counter for database cinder Sep 11 21:21:08 devstack cinder-volume[87096]: DEBUG oslo_db.sqlalchemy.engines [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writer thread running {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 21:21:09 devstack cinder-volume[87096]: INFO cinder.rpc [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 21:21:09 devstack cinder-volume[87096]: INFO cinder.rpc [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_db.sqlalchemy.engines [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:21:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Determined volume DB was empty at startup. Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87096) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 21:21:09 devstack cinder-volume[87096]: WARNING stevedore.named [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 21:21:09 devstack cinder-volume[87096]: WARNING castellan.key_manager [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 21:21:09 devstack cinder-volume[87096]: WARNING cinder.keymgr.conf_key_mgr [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 21:21:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_db.sqlalchemy.engines [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:21:09 devstack cinder-volume[87096]: INFO oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Starting 1 workers Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Started child 87423 {{(pid=87096) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Full set of CONF: {{(pid=87096) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] ******************************************************************************** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] Configuration options gathered from: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 21:21:09 devstack cinder-volume[87423]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] ================================================================================ {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] allow_availability_zone_fallback = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] allow_compression_on_image_upload = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] allowed_direct_url_schemes = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] api_rate_limit = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] auth_strategy = keystone {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_availability_zone = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_host = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_stats_polling_interval = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backup_api_class = cinder.backup.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backup_name_template = backup-%s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backup_use_same_host = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backup_use_temp_snapshot = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] chap_password = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] chap_username = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cinder_internal_tenant_project_id = 2d2aabbf803b43b8a227a6904dc87592 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cinder_internal_tenant_user_id = 2aa185e4d18a4f1a91b599926445d4b5 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cluster = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] compression_format = gzip {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] compute_api_class = cinder.compute.nova.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] config_dir = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] config_source = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] control_exchange = openstack {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] debug = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] default_availability_zone = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] default_group_type = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] default_volume_type = QuobyteHD {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] disk_geometry = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] driver_client_cert = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] driver_client_cert_key = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] driver_data_namespace = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] driver_ssl_cert_path = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] driver_ssl_cert_verify = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] driver_use_ssl = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87423) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] enable_new_services = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] enable_unsupported_driver = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] enabled_backends = ['QuobyteHD'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] enforce_multipath_for_image_xfer = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] filter_function = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_api_insecure = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_api_servers = ['http://192.168.122.57/image'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_api_ssl_compression = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_ca_certificates_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_catalog_info = image:glance:publicURL {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_keyfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_num_retries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance_request_timeout = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] goodness_function = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] graceful_shutdown_timeout = 5 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] group_api_class = cinder.group.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] host = devstack {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_compress_on_upload = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_conversion_address_space_limit = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_conversion_cpu_limit = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_conversion_disable = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_introspection_address_space_limit = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_introspection_cpu_limit = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_upload_use_cinder_backend = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_upload_use_internal_tenant = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_volume_cache_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_volume_cache_max_count = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] image_volume_cache_max_size_gb = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] init_host_max_objects_retrieval = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] instance_format = [instance: %(uuid)s] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] iscsi_target_flags = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] iscsi_write_cache = on {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] iser_helper = tgtadm {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] iser_ip_address = 192.168.122.57 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] iser_port = 3260 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] log_color = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] log_config_append = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] log_dir = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] log_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] log_options = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] log_rotate_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] log_rotate_interval_type = days {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] log_rotation_type = none {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] max_age = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] max_logfile_count = 30 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] max_logfile_size_mb = 200 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] max_over_subscription_ratio = 20.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] message_reap_interval = 86400 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] message_ttl = 2592000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] migration_create_volume_timeout_secs = 300 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] monkey_patch = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] monkey_patch_modules = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] my_ip = 192.168.122.57 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] no_snapshot_gb_quota = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] num_iser_scan_tries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] num_shell_tries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] num_volume_device_scan_tries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] nvmeof_conn_info_version = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] nvmet_ns_id = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] nvmet_port_id = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] osapi_max_limit = 1000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] osapi_volume_ext_list = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] osapi_volume_listen = 0.0.0.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] osapi_volume_listen_port = 8776 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] osapi_volume_use_ssl = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] osapi_volume_workers = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] per_volume_size_limit = -1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87423) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] periodic_fuzzy_delay = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] periodic_interval = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] project_id_regex = [0-9a-f\-]+ {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] public_endpoint = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] publish_errors = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] quota_backup_gigabytes = 1000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.quobyte [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 11 21:21:09 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.quobyte [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Running cmd (subprocess): mount.quobyte {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] quota_backups = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] quota_gigabytes = 1000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] quota_groups = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] quota_snapshots = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] quota_volumes = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] rate_limit_burst = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] rate_limit_except_level = CRITICAL {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] rate_limit_interval = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] reinit_driver_count = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] replication_device = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] report_discard_supported = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] report_interval = 120 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] reservation_clean_interval = 86400 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] reservation_expire = 86400 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] reserved_image_namespaces = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] reserved_percentage = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] rpc_response_timeout = 120 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] run_external_periodic_tasks = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] scst_target_driver = iscsi {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] scst_target_iqn_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_down_time = 720 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] shell_completion = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] snapshot_name_template = snapshot-%s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] split_loggers = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] state_path = /opt/stack/data/cinder {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] storage_availability_zone = nova {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] storage_protocol = iSCSI {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] syslog_log_facility = LOG_USER {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] target_helper = lioadm {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] target_ip_address = 192.168.122.57 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] target_port = 3260 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] target_protocol = iscsi {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] target_secondary_ip_addresses = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] trace_flags = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] transfer_api_class = cinder.transfer.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] transport_url = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] until_refresh = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] use_chap_auth = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] use_default_quota_class = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] use_journal = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] use_json = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] use_multipath_for_image_xfer = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] use_stderr = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] use_syslog = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] verify_glance_signatures = enabled {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_api_class = cinder.volume.api.API {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_backend_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_clear = zero {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_clear_ionice = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_clear_size = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_copy_bps_limit = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_dd_blocksize = 1M {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_name_template = volume-%s {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_service_inithost_offload = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volume_usage_audit_period = month {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] zoning_mode = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_concurrency.disable_process_locking = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.auth_section = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.auth_type = password {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.auth_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.cache = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.delay_auth_decision = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.http_connect_timeout = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.include_service_catalog = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.insecure = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.interface = public {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.keyfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_password = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcache_username = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.region_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.service_token_roles_required = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.service_type = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.token_cache_time = 300 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.57/identity {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.backend = dogpile.cache.null {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.backend_argument = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.backend_expiration_time = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.config_prefix = cache.oslo {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.debug_cache_backend = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.enable_retry_client = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.enable_socket_keepalive = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.expiration_time = 600 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.hashclient_retry_attempts = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.memcache_dead_retry = 300 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.memcache_pool_maxsize = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.memcache_sasl_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:21:09 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.password = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.proxies = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.redis_db = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.redis_sentinel_service_name = mymaster {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.redis_server = localhost:6379 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.retry_attempts = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.retry_delay = 0.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.socket_keepalive_count = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.socket_keepalive_idle = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.socket_keepalive_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.socket_timeout = 1.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.tls_allowed_ciphers = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.tls_cafile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.tls_certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.tls_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.tls_keyfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cache.username = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] coordination.backend_url = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.asyncio_connection = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.asyncio_slave_connection = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.backend = sqlalchemy {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.connection = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.connection_debug = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.connection_parameters = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.connection_recycle_time = 3600 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.connection_trace = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.db_inc_retry_interval = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.db_max_retries = 20 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.db_max_retry_interval = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.db_retry_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.max_overflow = 50 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.max_pool_size = 5 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.max_retries = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.mysql_wsrep_sync_wait = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.pool_timeout = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.retry_interval = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.slave_connection = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.sqlite_synchronous = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.synchronous_reader = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] database.use_db_reconnect = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_tracing.insecure = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.connection_string = messaging:// {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.es_doc_type = notification {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.es_scroll_size = 10000 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.es_scroll_time = 2m {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.filter_error_trace = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.hmac_keys = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.sentinel_service_name = mymaster {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.socket_timeout = 0.1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.trace_requests = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler.trace_sqlalchemy = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler_jaeger.process_tags = {} {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler_jaeger.service_name_prefix = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] profiler_otlp.service_name_prefix = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.enforce_new_defaults = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.policy_default_rule = default {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.policy_file = policy.yaml {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_policy.remote_timeout = 60.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] privsep_osbrick.group = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] privsep_osbrick.helper_command = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] privsep_osbrick.user = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cinder_sys_admin.group = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cinder_sys_admin.helper_command = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] cinder_sys_admin.user = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.auth_section = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.auth_type = password {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.cafile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.collect_timing = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.insecure = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.keyfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.send_service_user_token = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.split_loggers = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.timeout = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.tls_ciphers = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] service_user.tls_min_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.auth_section = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.auth_type = password {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.collect_timing = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.insecure = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.keyfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.region_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.split_loggers = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.timeout = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.tls_ciphers = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] glance.tls_min_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.backend_availability_zone = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.chap_password = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.chap_username = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.disk_geometry = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.driver_client_cert = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.driver_client_cert_key = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.driver_data_namespace = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.driver_use_ssl = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.enable_unsupported_driver = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.extra_capabilities = {} {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.filter_function = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.goodness_function = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.iscsi_target_flags = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.iscsi_write_cache = on {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.iser_helper = tgtadm {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.iser_ip_address = 192.168.122.57 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.iser_port = 3260 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_host = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_login = admin {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_mount_options = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_password = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_private_key = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_share_path = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_ssh_port = 22 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.num_shell_tries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.nvmet_port_id = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.quobyte_client_cfg = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.quobyte_volume_url = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.replication_device = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.report_discard_supported = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.reserved_percentage = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.scst_target_driver = iscsi {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.scst_target_iqn_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.storage_protocol = iSCSI {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.target_helper = tgtadm {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.target_ip_address = 192.168.122.57 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.target_port = 3260 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.target_protocol = iscsi {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.trace_flags = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.unique_fqdn_network = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.use_chap_auth = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.volume_backend_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.volume_clear = zero {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.volume_clear_ionice = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.volume_clear_size = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_reports.file_event_handler = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_reports.log_dir = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.backend_availability_zone = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.backend_host = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.chap_password = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.chap_username = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.chiscsi_conf = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.disk_geometry = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.driver_client_cert = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.driver_client_cert_key = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.driver_data_namespace = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.driver_use_ssl = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.extra_capabilities = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.filter_function = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.goodness_function = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.iscsi_target_flags = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.iscsi_write_cache = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.iser_helper = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.iser_ip_address = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.iser_port = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.iser_target_prefix = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_host = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_login = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_mount_options = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_password = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_private_key = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_share_path = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_ssh_port = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.num_shell_tries = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nvmet_ns_id = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.nvmet_port_id = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.replication_device = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.report_discard_supported = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.reserved_percentage = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.scst_target_driver = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.storage_protocol = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.target_helper = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.target_ip_address = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.target_port = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.target_prefix = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.target_protocol = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.trace_flags = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.unique_fqdn_network = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.use_chap_auth = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.volume_clear = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.volume_clear_ionice = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.volume_clear_size = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] QuobyteHD.volumes_dir = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.ssl = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.ssl_version = {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_notifications.driver = [] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_notifications.retry = -1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] oslo_messaging_notifications.transport_url = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] key_manager.fixed_key = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.barbican_api_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.barbican_endpoint = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.barbican_endpoint_type = public {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.barbican_region_name = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.cafile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.collect_timing = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.insecure = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.keyfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.number_of_retries = 60 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.retry_delay = 1 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.send_service_user_token = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.split_loggers = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.timeout = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.tls_ciphers = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.tls_min_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.verify_ssl = True {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican.verify_ssl_path = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.auth_section = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.auth_type = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.cafile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.certfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.collect_timing = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.insecure = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.keyfile = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.split_loggers = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.timeout = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.tls_ciphers = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] barbican_service_user.tls_min_version = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.approle_role_id = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.approle_secret_id = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.auth_method = approle {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.auth_path = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.kv_mountpoint = secret {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.kv_path = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.kv_version = 2 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.namespace = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.root_token_id = **** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.ssl_ca_crt_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.timeout = 60.0 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.token_file = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.token_role = None {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.use_ssl = False {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 21:21:09 devstack cinder-volume[87096]: DEBUG oslo_service.backend._eventlet.service [None req-f901563e-0dc0-48f5-9a36-f85d60755fba None None] ******************************************************************************** {{(pid=87096) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 21:21:09 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.256s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:21:09 devstack cinder-volume[87423]: INFO cinder.volume.driver [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Driver hasn't implemented _init_vendor_properties() Sep 11 21:21:09 devstack cinder-volume[87423]: DEBUG cinder.volume.driver [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2010765075684, 'free_capacity_gb': 1773.2010765075684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87423) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_db.sqlalchemy.engines [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87423) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writer thread running {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG cinder.db.api [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Building query based on filter {{(pid=87423) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87423) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:21:10 devstack cinder-volume[87423]: INFO cinder.keymgr.migration [None req-2e6ae79d-360f-41ad-95ae-d1701e56cf8f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 21:21:10 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:21:10 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:21:10 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.239s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:21:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Driver initialization completed successfully. Sep 11 21:21:10 devstack cinder-volume[87423]: INFO cinder.manager [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Initiating service 3 cleanup Sep 11 21:21:10 devstack cinder-volume[87423]: INFO cinder.manager [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Service 3 cleanup completed. Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG cinder.service [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Creating RPC server for service cinder-volume {{(pid=87423) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG cinder.service [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87423) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 21:21:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:21:10 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:21:10 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:21:10 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Sep 11 21:21:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.229s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:21:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-875ed321-fb26-4f36-9a04-b4b0886082b3 None None] Driver post RPC initialization completed successfully. Sep 11 21:21:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:21:15 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 6 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:21:15 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:21:19 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:21:20 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=2 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:21:20 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Flow 'volume_create_manager' (6f182283-b69f-44dc-a673-b4fa0628fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16208c87-47b0-4cfa-acd5-90f2f6b7aa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16208c87-47b0-4cfa-acd5-90f2f6b7aa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1278105560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2c5e73-5c14-4d9c-b9d0-f377372f85d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b2b75b0a1f4aebaa83189a687674d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:08Z,use_quota=True,user_id='dcbe4b8d2bb9450bade2d75b025aea62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad431415-c0ef-468b-bc9e-70211eeacdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad431415-c0ef-468b-bc9e-70211eeacdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76229c8-3c34-40e1-8bc6-a1424f03bd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76229c8-3c34-40e1-8bc6-a1424f03bd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2c5e73-5c14-4d9c-b9d0-f377372f85d1', 'volume_name': 'volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22687ce0-b538-4f5b-8281-f744c6299393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22687ce0-b538-4f5b-8281-f744c6299393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37dacb86-f92c-47b3-87f7-f872b80f459c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Volume fb2c5e73-5c14-4d9c-b9d0-f377372f85d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1', 'volume_size': 1} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1278105560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2c5e73-5c14-4d9c-b9d0-f377372f85d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b2b75b0a1f4aebaa83189a687674d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:08Z,use_quota=True,user_id='dcbe4b8d2bb9450bade2d75b025aea62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Creating volume fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:22:08 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:08 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 1073741824 Sep 11 21:22:08 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Flow 'volume_create_manager' (dca8a6c5-6acb-4635-9e67-ad2dc8a1f13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912f3654-3431-4fa2-800d-567dedd354fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912f3654-3431-4fa2-800d-567dedd354fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-663796014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ddf5e1-9d86-4382-aa5a-7e27f373a4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed1368b41504ad197025168a552afbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:08Z,use_quota=True,user_id='b397715c9e804ecfa6f94946631eefd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba77bc62-69f3-4704-9fbb-7ea0b8eef366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba77bc62-69f3-4704-9fbb-7ea0b8eef366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5512b82-9057-4e20-abe8-e05baef159f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5512b82-9057-4e20-abe8-e05baef159f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ddf5e1-9d86-4382-aa5a-7e27f373a4a2', 'volume_name': 'volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51fe618-d942-49e4-97c6-a73799335a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51fe618-d942-49e4-97c6-a73799335a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bb6158-d894-4ffb-bd84-0f6f140a84cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:08 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Volume 63ddf5e1-9d86-4382-aa5a-7e27f373a4a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2', 'volume_size': 1} Sep 11 21:22:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:09 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 1073741824" returned: 0 in 0.694s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:09 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 Sep 11 21:22:09 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:09 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" returned: 0 in 0.252s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-663796014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ddf5e1-9d86-4382-aa5a-7e27f373a4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed1368b41504ad197025168a552afbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:08Z,use_quota=True,user_id='b397715c9e804ecfa6f94946631eefd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Creating volume 63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:22:09 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37dacb86-f92c-47b3-87f7-f872b80f459c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70e9d89-e9fd-4cca-9e8d-1b4066c01f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:09 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 1073741824 Sep 11 21:22:09 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Volume volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 (fb2c5e73-5c14-4d9c-b9d0-f377372f85d1): created successfully Sep 11 21:22:09 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70e9d89-e9fd-4cca-9e8d-1b4066c01f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Flow 'volume_create_manager' (6f182283-b69f-44dc-a673-b4fa0628fc19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-1e58051e-0a3d-49c5-a1c5-3321796cd78e req-3992d413-9e30-4fb1-b5c3-29e426175722 tempest-VolumesSnapshotsTestJSON-1428266375 None] Created volume successfully. Sep 11 21:22:10 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 1073741824" returned: 0 in 0.703s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:10 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 Sep 11 21:22:10 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:10 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2" returned: 0 in 0.319s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bb6158-d894-4ffb-bd84-0f6f140a84cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbcabbf7-996f-4bc3-b854-ce18eaa106d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:10 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Volume volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 (63ddf5e1-9d86-4382-aa5a-7e27f373a4a2): created successfully Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbcabbf7-996f-4bc3-b854-ce18eaa106d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Flow 'volume_create_manager' (dca8a6c5-6acb-4635-9e67-ad2dc8a1f13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d9f9768e-5b86-4c4b-a617-fa7ca1dc319c tempest-TaggedAttachmentsTest-813279072 None] Created volume successfully. Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Creating offline snapshot 3c530a1d-7c5f-407f-b512-dda6829ba16b of volume fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:22:10 devstack cinder-volume[87423]: INFO oslo.privsep.daemon [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqwz568o0/privsep.sock'] Sep 11 21:22:10 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqwz568o0/privsep.sock Sep 11 21:22:10 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:11 devstack cinder-volume[87423]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 11 21:22:11 devstack cinder-volume[87423]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 21:22:11 devstack cinder-volume[87423]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 11 21:22:11 devstack cinder-volume[87423]: WARNING oslo.privsep.daemon [-] privsep log: Sep 11 21:22:11 devstack cinder-volume[87423]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 11 21:22:11 devstack cinder-volume[87423]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 11 21:22:11 devstack cinder-volume[87423]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 21:22:11 devstack cinder-volume[87423]: WARNING oslo.privsep.daemon [-] privsep log: Sep 11 21:22:11 devstack cinder-volume[87423]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 11 21:22:12 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:12 devstack cinder-volume[87423]: INFO oslo.privsep.daemon [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Spawned new privsep daemon via rootwrap Sep 11 21:22:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Accepted privsep connection to /tmp/tmpqwz568o0/privsep.sock {{(pid=87423) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 11 21:22:12 devstack cinder-volume[87423]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 11 21:22:12 devstack cinder-volume[87423]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 11 21:22:12 devstack cinder-volume[87423]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 11 21:22:12 devstack cinder-volume[87423]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88056 Sep 11 21:22:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db435fc-6e7f-4c29-b249-0d330e967037]: (2,) {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:22:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bcdf70-8568-477d-b04f-8fb6529e4ddb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:22:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:12 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 Sep 11 21:22:12 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:12 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" returned: 0 in 0.483s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:12 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b 1G Sep 11 21:22:12 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:13 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b 1G" returned: 0 in 0.499s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:13 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b Sep 11 21:22:13 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:13 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b" returned: 0 in 0.400s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:13 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b is being set with open permissions: ugo+rw Sep 11 21:22:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:13 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b Sep 11 21:22:13 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:13 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b" returned: 0 in 0.278s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:13 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.info Sep 11 21:22:13 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:14 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.info" returned: 0 in 0.477s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:14 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.info is being set with open permissions: ugo+rw Sep 11 21:22:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:14 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.info Sep 11 21:22:14 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:14 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.info" returned: 0 in 0.372s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:14 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-3587c9bd-e11b-49ab-8aa3-3a7a9dc5e681 req-914deb17-7173-493d-9b5b-375079dab8a1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Create snapshot completed successfully Sep 11 21:22:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:22:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:15 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:22:15 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:16 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.473s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 8 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Acquiring lock "cinder-3c530a1d-7c5f-407f-b512-dda6829ba16b-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-3c530a1d-7c5f-407f-b512-dda6829ba16b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Acquiring lock "cinder-quobyte-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-quobyte-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Acquiring lock "cinder-quobyte-3c530a1d-7c5f-407f-b512-dda6829ba16b" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-quobyte-3c530a1d-7c5f-407f-b512-dda6829ba16b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Deleting offline snapshot 3c530a1d-7c5f-407f-b512-dda6829ba16b of volume fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] snapshot_file for this snap is: volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[802d707f-8016-4243-a854-70414d37ddd2]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:16 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b Sep 11 21:22:16 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:16 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b" returned: 0 in 0.587s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:22:17 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d9235a-e47f-4772-909e-eab2be01851c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:22:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:17 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 Sep 11 21:22:17 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:17 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" returned: 0 in 0.605s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:17 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b Sep 11 21:22:17 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:18 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b" returned: 0 in 0.633s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:18 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b Sep 11 21:22:18 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:18 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1.3c530a1d-7c5f-407f-b512-dda6829ba16b" returned: 0 in 0.452s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-quobyte-3c530a1d-7c5f-407f-b512-dda6829ba16b" released by "_delete_snapshot" :: held 2.471s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-quobyte-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" released by "delete_snapshot" :: held 2.516s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:18 devstack cinder-volume[87423]: WARNING cinder.quota [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:22:18 devstack cinder-volume[87423]: WARNING cinder.quota [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:22:19 devstack cinder-volume[87423]: DEBUG cinder.quota [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Created reservations ['38d0871f-ad02-4205-8b54-deaea1ef01ac', 'e7c6f998-c2fd-4e71-8165-51c3577bb2fe', '119f7bfc-fae3-4483-8895-f4eae7284009', 'd9dc6c62-f369-40f5-8aa7-e1e0c145e547'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:22:19 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Delete snapshot completed successfully. Sep 11 21:22:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-c593bd76-3dde-4e4f-802a-7304b8aefb25 req-f06fbca2-4340-4d51-91b8-b3b8d874c6d1 tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-3c530a1d-7c5f-407f-b512-dda6829ba16b-delete_snapshot" released by "delete_snapshot" :: held 2.955s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Acquiring lock "cinder-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Acquiring lock "cinder-quobyte-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-quobyte-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" acquired by "delete_volume" :: waited 0.047s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aea2c61-a7f8-4d7e-bf5b-8f8af3136c68]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:22:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:21 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 Sep 11 21:22:21 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:21 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" returned: 0 in 0.455s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:21 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1 Sep 11 21:22:21 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:21 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" returned: 0 in 0.352s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-quobyte-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1" released by "delete_volume" :: held 0.904s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:21 devstack cinder-volume[87423]: WARNING cinder.quota [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG cinder.quota [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Created reservations ['63d2f960-361c-47d2-840a-c751733a837c', 'c95e8281-3f5c-476e-aeca-1439e02ad85a', 'c56a9726-f789-4ecd-9b1f-cffabc1475b2', 'cf6fc13b-50d0-48cd-ade4-adbaa4a3714e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:21 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:22:21 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:22 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.329s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:22 devstack cinder-volume[87423]: DEBUG cinder.manager [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:22:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Deleted volume successfully. Sep 11 21:22:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-45e2c38b-f3d5-4711-bff3-7069621c3f47 req-5256cf60-796a-420b-b408-15419b927fad tempest-VolumesSnapshotsTestJSON-1428266375 None] Lock "cinder-fb2c5e73-5c14-4d9c-b9d0-f377372f85d1-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Flow 'volume_create_manager' (f94a2224-a2c7-4bd0-abe9-9522da3bdd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5328869d-11fc-4337-8556-d1b7f3f58f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5328869d-11fc-4337-8556-d1b7f3f58f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-317198483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387c9e92-09ff-4ce3-b1d0-26e78bd04248,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4554ee7c50343c685693adf96e3fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:29Z,use_quota=True,user_id='6f9125acabf042aa9d3493eb48a5ed1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b84e353-c43f-4454-922b-011de4e7ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b84e353-c43f-4454-922b-011de4e7ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ad4252-9823-420d-8a80-f1f8a4267632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ad4252-9823-420d-8a80-f1f8a4267632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387c9e92-09ff-4ce3-b1d0-26e78bd04248', 'volume_name': 'volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc4627d-1c96-402f-bddf-c77cbc952f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc4627d-1c96-402f-bddf-c77cbc952f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b728c9a-4195-47f5-a16e-97859b067038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:29 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Volume 387c9e92-09ff-4ce3-b1d0-26e78bd04248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248', 'volume_size': 1} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-317198483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387c9e92-09ff-4ce3-b1d0-26e78bd04248,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4554ee7c50343c685693adf96e3fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:29Z,use_quota=True,user_id='6f9125acabf042aa9d3493eb48a5ed1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Creating volume 387c9e92-09ff-4ce3-b1d0-26e78bd04248 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:22:29 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:22:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:29 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 1073741824 Sep 11 21:22:29 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:30 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 1073741824" returned: 0 in 0.919s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:30 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 Sep 11 21:22:30 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:31 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248" returned: 0 in 0.476s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b728c9a-4195-47f5-a16e-97859b067038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9314221-2c16-4c2c-b5f2-b7cfb99c222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:31 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Volume volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 (387c9e92-09ff-4ce3-b1d0-26e78bd04248): created successfully Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9314221-2c16-4c2c-b5f2-b7cfb99c222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Flow 'volume_create_manager' (f94a2224-a2c7-4bd0-abe9-9522da3bdd49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-865fd0d8-4cba-4935-89e0-4bd219b795da tempest-VolumesTestJSON-914656790 None] Created volume successfully. Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Flow 'volume_create_manager' (e514bc15-c53a-40b3-9203-c2755ec43524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fed44b8-9c3e-482d-96fd-d52416c305dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fed44b8-9c3e-482d-96fd-d52416c305dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-168174076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db246803-affa-4bfa-8adb-c141503250d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c694462b5548af8d9404f11ab81693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:31Z,use_quota=True,user_id='5c479d18090843c2ad820ea7266ab989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7fcf29-a619-47a9-a396-d4e13dce0618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7fcf29-a619-47a9-a396-d4e13dce0618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70d3064-237e-41ae-9cbb-d23a3951e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70d3064-237e-41ae-9cbb-d23a3951e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db246803-affa-4bfa-8adb-c141503250d2', 'volume_name': 'volume-db246803-affa-4bfa-8adb-c141503250d2', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c3e1f8-bcfa-4b3f-9f8c-2c2535c93fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c3e1f8-bcfa-4b3f-9f8c-2c2535c93fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3183f2a8-4183-4d6c-aed3-29d8b94adad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:31 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Volume db246803-affa-4bfa-8adb-c141503250d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db246803-affa-4bfa-8adb-c141503250d2', 'volume_size': 1} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-168174076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db246803-affa-4bfa-8adb-c141503250d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c694462b5548af8d9404f11ab81693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:31Z,use_quota=True,user_id='5c479d18090843c2ad820ea7266ab989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Creating volume db246803-affa-4bfa-8adb-c141503250d2 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:22:31 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:22:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:32 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2 1073741824 Sep 11 21:22:32 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:33 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2 1073741824" returned: 0 in 1.069s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:33 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2 Sep 11 21:22:33 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Flow 'volume_create_manager' (478e7d0e-7c2a-4c84-8e7f-4e10aa09b68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b274d-f8d9-41c3-ad6d-2b5b8d644bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b274d-f8d9-41c3-ad6d-2b5b8d644bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1889307434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4f66d8-9f66-4c14-9900-4fc9e78f1b34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4554ee7c50343c685693adf96e3fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:33Z,use_quota=True,user_id='6f9125acabf042aa9d3493eb48a5ed1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41f5a96-4e26-4e7e-9f35-fde2ecf5ec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41f5a96-4e26-4e7e-9f35-fde2ecf5ec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0533d28f-7f42-437d-bf7c-07e8497f04ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0533d28f-7f42-437d-bf7c-07e8497f04ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4f66d8-9f66-4c14-9900-4fc9e78f1b34', 'volume_name': 'volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d6777c-c12e-45fc-8a65-d32965a9be0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d6777c-c12e-45fc-8a65-d32965a9be0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd65ca50-9d63-4f9f-952d-776aeaf34e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:33 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Volume fd4f66d8-9f66-4c14-9900-4fc9e78f1b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34', 'volume_size': 1} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:33 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2" returned: 0 in 0.747s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1889307434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4f66d8-9f66-4c14-9900-4fc9e78f1b34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4554ee7c50343c685693adf96e3fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:33Z,use_quota=True,user_id='6f9125acabf042aa9d3493eb48a5ed1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Creating volume fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:22:33 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3183f2a8-4183-4d6c-aed3-29d8b94adad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db246803-affa-4bfa-8adb-c141503250d2', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:33 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 1073741824 Sep 11 21:22:33 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a778c9-3948-4fbe-8f82-02f7842ec222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:34 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Volume volume-db246803-affa-4bfa-8adb-c141503250d2 (db246803-affa-4bfa-8adb-c141503250d2): created successfully Sep 11 21:22:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a778c9-3948-4fbe-8f82-02f7842ec222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Flow 'volume_create_manager' (e514bc15-c53a-40b3-9203-c2755ec43524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3b93896a-ddc0-4f81-a13a-453818c84de2 tempest-VolumesAdminNegativeTest-345062366 None] Created volume successfully. Sep 11 21:22:35 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 1073741824" returned: 0 in 1.143s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:35 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 Sep 11 21:22:35 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:35 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:22:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd65ca50-9d63-4f9f-952d-776aeaf34e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5826cfbe-27fc-4afe-96ec-9210f74ba192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:35 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Volume volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 (fd4f66d8-9f66-4c14-9900-4fc9e78f1b34): created successfully Sep 11 21:22:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5826cfbe-27fc-4afe-96ec-9210f74ba192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Flow 'volume_create_manager' (478e7d0e-7c2a-4c84-8e7f-4e10aa09b68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:35 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d9d87bc1-63b1-4fd1-ad8e-c4619584b2f4 tempest-VolumesTestJSON-914656790 None] Created volume successfully. Sep 11 21:22:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Acquiring lock "cinder-db246803-affa-4bfa-8adb-c141503250d2-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Lock "cinder-db246803-affa-4bfa-8adb-c141503250d2-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Acquiring lock "cinder-quobyte-db246803-affa-4bfa-8adb-c141503250d2" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Lock "cinder-quobyte-db246803-affa-4bfa-8adb-c141503250d2" acquired by "delete_volume" :: waited 0.060s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:36 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2caaf0-6524-409f-96d8-d386edfdc870]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:22:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:36 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2 Sep 11 21:22:36 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:37 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2" returned: 0 in 0.749s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:37 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2 Sep 11 21:22:37 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:37 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db246803-affa-4bfa-8adb-c141503250d2" returned: 0 in 0.412s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Lock "cinder-quobyte-db246803-affa-4bfa-8adb-c141503250d2" released by "delete_volume" :: held 1.314s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:37 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Created reservations ['3793c3d4-70d9-4990-bf17-a56b9e78fb2e', 'dd891785-94c2-4dfa-a55f-461d57bb8ee0', 'ee2246a5-b552-40b1-b646-4018462efa57', '4d7ede06-7926-40c5-8f10-5bcd100e7628'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:38 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:22:38 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Flow 'volume_create_manager' (ebeae5d2-3e33-4877-8ae6-eb53ed1a2526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b834af40-1260-4671-953d-8db7a5816348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b834af40-1260-4671-953d-8db7a5816348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-273197812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bfd38b-e2c0-48c7-a3e2-682f74cc1830,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4554ee7c50343c685693adf96e3fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:38Z,use_quota=True,user_id='6f9125acabf042aa9d3493eb48a5ed1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c678d17f-6fa7-4355-a939-d353587c38e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c678d17f-6fa7-4355-a939-d353587c38e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7674d0-8048-4e4d-acd9-bcbb0d288d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:38 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7674d0-8048-4e4d-acd9-bcbb0d288d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9bfd38b-e2c0-48c7-a3e2-682f74cc1830', 'volume_name': 'volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de08c48c-49f6-4bcc-b76a-adf42d3a96cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de08c48c-49f6-4bcc-b76a-adf42d3a96cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1323bfd-a6ac-4f75-b1ae-fe7331a57335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:38 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Volume c9bfd38b-e2c0-48c7-a3e2-682f74cc1830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830', 'volume_size': 1} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-273197812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bfd38b-e2c0-48c7-a3e2-682f74cc1830,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4554ee7c50343c685693adf96e3fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:38Z,use_quota=True,user_id='6f9125acabf042aa9d3493eb48a5ed1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Creating volume c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:22:38 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.610s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:38 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:22:38 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 1073741824 Sep 11 21:22:38 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Deleted volume successfully. Sep 11 21:22:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5f4494f9-c415-462b-b494-8a13ad3634b1 tempest-VolumesAdminNegativeTest-345062366 None] Lock "cinder-db246803-affa-4bfa-8adb-c141503250d2-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:40 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 1073741824" returned: 0 in 1.527s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:40 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 Sep 11 21:22:40 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:41 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830" returned: 0 in 0.517s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:22:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1323bfd-a6ac-4f75-b1ae-fe7331a57335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433982d3-c6b4-4946-bb66-29d41cbc992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:41 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Volume volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 (c9bfd38b-e2c0-48c7-a3e2-682f74cc1830): created successfully Sep 11 21:22:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433982d3-c6b4-4946-bb66-29d41cbc992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Flow 'volume_create_manager' (ebeae5d2-3e33-4877-8ae6-eb53ed1a2526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3d8e0ed6-f94f-4ef8-86fc-ceb1a416d0b5 tempest-VolumesTestJSON-914656790 None] Created volume successfully. Sep 11 21:22:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Acquiring lock "cinder-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Lock "cinder-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Acquiring lock "cinder-quobyte-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Lock "cinder-quobyte-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:43 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ea4607-cf87-4886-8968-d94b6728f858]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:22:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:43 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 Sep 11 21:22:43 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:44 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830" returned: 0 in 0.425s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:44 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830 Sep 11 21:22:44 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:44 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830" returned: 0 in 0.280s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Lock "cinder-quobyte-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830" released by "delete_volume" :: held 0.771s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Created reservations ['82375530-f1c6-478a-954f-a1b9ed0ee9b9', '054becc6-a916-4c54-bb5e-732eaba110f8', '5bf996b9-81c0-473c-86c0-21b1b21d7d1d', '16f4529b-2637-4c74-840d-6f04a5dd5e21'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:44 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:22:44 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Acquiring lock "cinder-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Lock "cinder-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Acquiring lock "cinder-quobyte-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Lock "cinder-quobyte-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34" acquired by "delete_volume" :: waited 0.031s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a07c15f-cdfc-4131-b51f-6ab666fed780]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:45 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.509s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:22:45 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Deleted volume successfully. Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9026919e-4dc9-4f01-a5ee-bd06051343f2 tempest-VolumesTestJSON-914656790 None] Lock "cinder-c9bfd38b-e2c0-48c7-a3e2-682f74cc1830-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:45 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 Sep 11 21:22:45 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:45 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34" returned: 0 in 0.512s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:45 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34 Sep 11 21:22:45 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:45 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34" returned: 0 in 0.356s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Lock "cinder-quobyte-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34" released by "delete_volume" :: held 0.942s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Created reservations ['dd1a2593-7f4a-4cbe-96a0-ed4fad7def7d', '47ad3cd3-d4d4-4f0b-aa82-8c7a890afaac', '3644533c-61ba-42e8-aa07-3d5a426e7619', 'f45a8a99-1fa2-4a73-bea0-be0a43f51d0c'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:46 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:22:46 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:46 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.359s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:22:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Deleted volume successfully. Sep 11 21:22:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8f128ad3-fbde-420e-aa7c-691f31b98b8f tempest-VolumesTestJSON-914656790 None] Lock "cinder-fd4f66d8-9f66-4c14-9900-4fc9e78f1b34-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Acquiring lock "cinder-387c9e92-09ff-4ce3-b1d0-26e78bd04248-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Lock "cinder-387c9e92-09ff-4ce3-b1d0-26e78bd04248-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Acquiring lock "cinder-quobyte-387c9e92-09ff-4ce3-b1d0-26e78bd04248" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:22:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Lock "cinder-quobyte-387c9e92-09ff-4ce3-b1d0-26e78bd04248" acquired by "delete_volume" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:22:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5887c181-abc1-4e5e-abb2-406afa041a93]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:22:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:47 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 Sep 11 21:22:47 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:47 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248" returned: 0 in 0.559s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:48 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248 Sep 11 21:22:48 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:48 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-387c9e92-09ff-4ce3-b1d0-26e78bd04248" returned: 0 in 0.270s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Lock "cinder-quobyte-387c9e92-09ff-4ce3-b1d0-26e78bd04248" released by "delete_volume" :: held 0.872s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Created reservations ['a1758138-e821-42df-b9a5-4406ff3b6929', '41a16fbb-854d-4817-8053-6ac32055306d', 'f8ff6c3b-83d1-46ef-a752-5b71433f47bc', '6aa490d4-7692-4c4d-962b-eb26f128b69e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:48 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:22:48 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:48 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.301s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:22:48 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Deleted volume successfully. Sep 11 21:22:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8c69e665-1314-4645-b665-515f47610249 tempest-VolumesTestJSON-914656790 None] Lock "cinder-387c9e92-09ff-4ce3-b1d0-26e78bd04248-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:22:54 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6394e991-6141-4a95-9d8d-f7df10707fb7 tempest-GroupsTest-586612511 None] Group tempest-Group1-478817595: creating Sep 11 21:22:54 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6394e991-6141-4a95-9d8d-f7df10707fb7 tempest-GroupsTest-586612511 None] Group tempest-Group1-478817595: created successfully Sep 11 21:22:54 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6394e991-6141-4a95-9d8d-f7df10707fb7 tempest-GroupsTest-586612511 None] Create group completed successfully. Sep 11 21:22:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4eb4fc82-d14e-4dd1-a3ef-ba9d1b60cd21 tempest-GroupsTest-586612511 None] Group tempest-Group2-1749677971: creating Sep 11 21:22:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4eb4fc82-d14e-4dd1-a3ef-ba9d1b60cd21 tempest-GroupsTest-586612511 None] Group tempest-Group2-1749677971: created successfully Sep 11 21:22:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4eb4fc82-d14e-4dd1-a3ef-ba9d1b60cd21 tempest-GroupsTest-586612511 None] Create group completed successfully. Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Flow 'volume_create_manager' (4e62e729-e544-4bdd-83ae-5107f3c7b94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e3ae0e-f57b-4805-9a98-4c8a157a2566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e3ae0e-f57b-4805-9a98-4c8a157a2566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1859572877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01dc3c32-01fc-4e1c-ad38-84113c846126,host='devstack@QuobyteHD#QuobyteHD',id=059ca79d-5219-4e08-9039-c726ca804a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515c61f2221d487aaf3ce8d4e80ac5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:58Z,use_quota=True,user_id='7bdb584913624411b65eb2821e823ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d246b49c-1192-4bed-af31-ce35570312ba),volume_type_id=d246b49c-1192-4bed-af31-ce35570312ba)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157b4d92-58f8-457b-840b-4fd83ed7fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157b4d92-58f8-457b-840b-4fd83ed7fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a9e916-8002-49bc-9635-61a5cc04e434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a9e916-8002-49bc-9635-61a5cc04e434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059ca79d-5219-4e08-9039-c726ca804a9b', 'volume_name': 'volume-059ca79d-5219-4e08-9039-c726ca804a9b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bbe732-dbdc-4926-83fd-5018ec254067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bbe732-dbdc-4926-83fd-5018ec254067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea24562e-cc64-482a-914a-54695f6b1350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:58 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Volume 059ca79d-5219-4e08-9039-c726ca804a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059ca79d-5219-4e08-9039-c726ca804a9b', 'volume_size': 1} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=01dc3c32-01fc-4e1c-ad38-84113c846126,created_at=2026-09-11T19:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1859572877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01dc3c32-01fc-4e1c-ad38-84113c846126,host='devstack@QuobyteHD#QuobyteHD',id=059ca79d-5219-4e08-9039-c726ca804a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515c61f2221d487aaf3ce8d4e80ac5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:22:58Z,use_quota=True,user_id='7bdb584913624411b65eb2821e823ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d246b49c-1192-4bed-af31-ce35570312ba),volume_type_id=d246b49c-1192-4bed-af31-ce35570312ba)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Creating volume 059ca79d-5219-4e08-9039-c726ca804a9b {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:22:58 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:22:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:58 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b 1073741824 Sep 11 21:22:58 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:59 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b 1073741824" returned: 0 in 0.793s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:22:59 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b Sep 11 21:22:59 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:22:59 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Sep 11 21:22:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b" returned: 0 in 0.408s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:22:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:22:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:22:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea24562e-cc64-482a-914a-54695f6b1350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059ca79d-5219-4e08-9039-c726ca804a9b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2cad56-3e4b-4898-990a-9fbf8aa2aa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:22:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Volume volume-059ca79d-5219-4e08-9039-c726ca804a9b (059ca79d-5219-4e08-9039-c726ca804a9b): created successfully Sep 11 21:22:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2cad56-3e4b-4898-990a-9fbf8aa2aa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:22:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Flow 'volume_create_manager' (4e62e729-e544-4bdd-83ae-5107f3c7b94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:22:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-15163b3a-5ac9-49d5-8f63-a121b1dbb894 tempest-GroupsTest-586612511 None] Created volume successfully. Sep 11 21:23:01 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=50,cinder:UPDATE=71,cinder:INSERT=17,cinder:DELETE=9 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:23:01 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=54,cinder:UPDATE=69,cinder:DELETE=4,cinder:INSERT=15 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:23:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Acquiring lock "cinder-quobyte-059ca79d-5219-4e08-9039-c726ca804a9b" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:23:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Lock "cinder-quobyte-059ca79d-5219-4e08-9039-c726ca804a9b" acquired by "delete_volume" :: waited 0.042s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:23:01 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70bfb74-ae30-4a1b-91bd-a8ba1a440bb9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:23:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:01 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b Sep 11 21:23:01 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:02 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b" returned: 0 in 0.449s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:02 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b Sep 11 21:23:02 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:02 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-059ca79d-5219-4e08-9039-c726ca804a9b" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Lock "cinder-quobyte-059ca79d-5219-4e08-9039-c726ca804a9b" released by "delete_volume" :: held 0.798s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Created reservations ['33426087-4db0-46dd-8496-3d9dd9244e02'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:23:02 devstack cinder-volume[87423]: WARNING cinder.quota [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2010776513 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2010776513, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:23:02 devstack cinder-volume[87423]: WARNING cinder.quota [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2010776513 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2010776513, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Created reservations ['c0b5f46c-e948-46f6-8ff4-8f7c22c4df89', '5136c6ec-e23e-496a-97a0-705474eef9c7', 'f9256aea-1746-4750-8ff9-60af443428e2', 'b595d374-8da8-4719-ab33-b6afff3b74f4'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:02 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:23:02 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:03 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.370s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:23:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6d9b0bf9-ad6b-4041-b945-6283232bb833 tempest-GroupsTest-586612511 None] Delete group completed successfully. Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] Created reservations ['7d9f1f49-454a-4f08-a487-8fade2a16c56'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:03 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:23:03 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:03 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.271s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:03 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:23:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-72828fe0-3c96-41a3-a935-ca3fe8a0e9b7 tempest-GroupsTest-586612511 None] Delete group completed successfully. Sep 11 21:23:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ec82abe8-4830-4ffb-b1f7-4371fba2202d tempest-GroupsTest-586612511 None] Group tempest-GroupsTest-Group-835322497: creating Sep 11 21:23:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ec82abe8-4830-4ffb-b1f7-4371fba2202d tempest-GroupsTest-586612511 None] Group tempest-GroupsTest-Group-835322497: created successfully Sep 11 21:23:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ec82abe8-4830-4ffb-b1f7-4371fba2202d tempest-GroupsTest-586612511 None] Create group completed successfully. Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Flow 'volume_create_manager' (13c4446a-bb6c-4f6d-8ce0-0237a3a4160d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641f201b-6d58-4244-a13c-9e8efdfa0558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641f201b-6d58-4244-a13c-9e8efdfa0558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370602927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59214220-d0ca-42ae-ad96-2fe51ed68d24,host='devstack@QuobyteHD#QuobyteHD',id=eeec9d13-c8ce-46bb-8773-8584f295ee5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515c61f2221d487aaf3ce8d4e80ac5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:23:07Z,use_quota=True,user_id='7bdb584913624411b65eb2821e823ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bad3b1-706b-431a-822b-01f784886387),volume_type_id=45bad3b1-706b-431a-822b-01f784886387)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ddd2a3-3831-47e2-a6e1-0f73713e5cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ddd2a3-3831-47e2-a6e1-0f73713e5cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0395da-e20d-4bef-bfda-e734f9d9a5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0395da-e20d-4bef-bfda-e734f9d9a5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeec9d13-c8ce-46bb-8773-8584f295ee5d', 'volume_name': 'volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11bf909-668c-409c-a219-e1823c3fa5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11bf909-668c-409c-a219-e1823c3fa5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e839edda-daca-4f6b-8c5e-103211da6076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Volume eeec9d13-c8ce-46bb-8773-8584f295ee5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d', 'volume_size': 1} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59214220-d0ca-42ae-ad96-2fe51ed68d24,created_at=2026-09-11T19:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370602927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59214220-d0ca-42ae-ad96-2fe51ed68d24,host='devstack@QuobyteHD#QuobyteHD',id=eeec9d13-c8ce-46bb-8773-8584f295ee5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515c61f2221d487aaf3ce8d4e80ac5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:23:07Z,use_quota=True,user_id='7bdb584913624411b65eb2821e823ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bad3b1-706b-431a-822b-01f784886387),volume_type_id=45bad3b1-706b-431a-822b-01f784886387)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Creating volume eeec9d13-c8ce-46bb-8773-8584f295ee5d {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:23:07 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:23:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:07 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d 1073741824 Sep 11 21:23:07 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:09 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d 1073741824" returned: 0 in 1.388s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:09 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d Sep 11 21:23:09 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:09 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d" returned: 0 in 0.402s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:23:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e839edda-daca-4f6b-8c5e-103211da6076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591a0c58-b055-4d96-849f-d3af08182426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:09 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Volume volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d (eeec9d13-c8ce-46bb-8773-8584f295ee5d): created successfully Sep 11 21:23:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591a0c58-b055-4d96-849f-d3af08182426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Flow 'volume_create_manager' (13c4446a-bb6c-4f6d-8ce0-0237a3a4160d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:23:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a5f103ed-ffb5-4d9a-b0e2-b0ed6ee17c89 tempest-GroupsTest-586612511 None] Created volume successfully. Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Flow 'volume_create_manager' (eb530491-b4b9-43ba-90a1-04dbeedabf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a6105c-b5ef-48ae-ad71-278a0c15c3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a6105c-b5ef-48ae-ad71-278a0c15c3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-595822875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59214220-d0ca-42ae-ad96-2fe51ed68d24,host='devstack@QuobyteHD#QuobyteHD',id=ea8647cf-808e-4229-b1d7-09bcac1836f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515c61f2221d487aaf3ce8d4e80ac5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:23:12Z,use_quota=True,user_id='7bdb584913624411b65eb2821e823ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bad3b1-706b-431a-822b-01f784886387),volume_type_id=45bad3b1-706b-431a-822b-01f784886387)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b9a792-43bb-43eb-9232-3c727ac7ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b9a792-43bb-43eb-9232-3c727ac7ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9371ecf-1632-440b-b58c-2c0e7869a22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9371ecf-1632-440b-b58c-2c0e7869a22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8647cf-808e-4229-b1d7-09bcac1836f9', 'volume_name': 'volume-ea8647cf-808e-4229-b1d7-09bcac1836f9', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc6fd72-f210-492c-ad85-96241f3c92f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc6fd72-f210-492c-ad85-96241f3c92f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98c205c-abc2-458d-9f6a-ddc9008e879a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:12 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Volume ea8647cf-808e-4229-b1d7-09bcac1836f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8647cf-808e-4229-b1d7-09bcac1836f9', 'volume_size': 1} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59214220-d0ca-42ae-ad96-2fe51ed68d24,created_at=2026-09-11T19:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-595822875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59214220-d0ca-42ae-ad96-2fe51ed68d24,host='devstack@QuobyteHD#QuobyteHD',id=ea8647cf-808e-4229-b1d7-09bcac1836f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515c61f2221d487aaf3ce8d4e80ac5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:23:12Z,use_quota=True,user_id='7bdb584913624411b65eb2821e823ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bad3b1-706b-431a-822b-01f784886387),volume_type_id=45bad3b1-706b-431a-822b-01f784886387)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Creating volume ea8647cf-808e-4229-b1d7-09bcac1836f9 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:23:12 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:23:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:12 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 1073741824 Sep 11 21:23:12 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:13 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 1073741824" returned: 0 in 0.905s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:13 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 Sep 11 21:23:13 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:14 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9" returned: 0 in 0.837s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:23:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98c205c-abc2-458d-9f6a-ddc9008e879a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8647cf-808e-4229-b1d7-09bcac1836f9', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd7433b-bf0b-4eee-95e8-057d9565ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:14 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Volume volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 (ea8647cf-808e-4229-b1d7-09bcac1836f9): created successfully Sep 11 21:23:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd7433b-bf0b-4eee-95e8-057d9565ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Flow 'volume_create_manager' (eb530491-b4b9-43ba-90a1-04dbeedabf8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:23:14 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b4d3dbad-b622-4c8b-a628-790d93cfc1a9 tempest-GroupsTest-586612511 None] Created volume successfully. Sep 11 21:23:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:23:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:15 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:23:15 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:15 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b4b7478f-a172-4bf7-9c7b-5078f3c7031f tempest-GroupsTest-586612511 None] Update group completed successfully. Sep 11 21:23:16 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.648s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:23:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:23:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 8 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:23:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:23:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6bcdd2d0-4e4e-4ef5-92d9-f8d4acf3196b tempest-GroupsTest-586612511 None] Update group completed successfully. Sep 11 21:23:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Acquiring lock "cinder-quobyte-ea8647cf-808e-4229-b1d7-09bcac1836f9" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:23:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Lock "cinder-quobyte-ea8647cf-808e-4229-b1d7-09bcac1836f9" acquired by "delete_volume" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:23:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ec25c-c556-41ae-8ba7-c6e60e366d10]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:23:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:20 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 Sep 11 21:23:20 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:20 devstack cinder-volume[87423]: WARNING py.warnings [req-104edcd0-4937-4d0e-b269-c1e048c421ab req-adf9b394-a2a9-4015-99c6-c5951d9073cd tempest-TaggedAttachmentsTest-813279072 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 11 21:23:20 devstack cinder-volume[87423]: .first() Sep 11 21:23:20 devstack cinder-volume[87423]: Sep 11 21:23:20 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Flow 'volume_create_manager' (6fe5b197-88dc-4abb-8a43-ad918257095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d09b9db-f60b-45a6-b7dd-a9b795aed288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d09b9db-f60b-45a6-b7dd-a9b795aed288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1713825667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8dfc9c-cda5-4d32-81f1-230214ee1f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0aa17bb001f41dd99e666507ff78494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:23:21Z,use_quota=True,user_id='e4c530aa29f7496dbbaebbe082d89f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d68df1-5b2c-4d54-8f62-4d483a0f9e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d68df1-5b2c-4d54-8f62-4d483a0f9e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d54325-db1d-4591-9203-6b42e493f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d54325-db1d-4591-9203-6b42e493f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8dfc9c-cda5-4d32-81f1-230214ee1f71', 'volume_name': 'volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4631a517-c86e-4b56-84ad-a9cbf0158f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4631a517-c86e-4b56-84ad-a9cbf0158f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637e1e60-0a10-42d3-a6f6-7082aa07885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:21 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Volume 1f8dfc9c-cda5-4d32-81f1-230214ee1f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71', 'volume_size': 1} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1713825667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8dfc9c-cda5-4d32-81f1-230214ee1f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0aa17bb001f41dd99e666507ff78494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:23:21Z,use_quota=True,user_id='e4c530aa29f7496dbbaebbe082d89f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Creating volume 1f8dfc9c-cda5-4d32-81f1-230214ee1f71 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:23:21 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:21 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 1073741824 Sep 11 21:23:21 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-104edcd0-4937-4d0e-b269-c1e048c421ab req-adf9b394-a2a9-4015-99c6-c5951d9073cd tempest-TaggedAttachmentsTest-813279072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:21 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9" returned: 0 in 1.032s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:21 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9 Sep 11 21:23:21 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:21 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea8647cf-808e-4229-b1d7-09bcac1836f9" returned: 0 in 0.438s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Lock "cinder-quobyte-ea8647cf-808e-4229-b1d7-09bcac1836f9" released by "delete_volume" :: held 1.553s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Acquiring lock "cinder-quobyte-eeec9d13-c8ce-46bb-8773-8584f295ee5d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:23:21 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 1073741824" returned: 0 in 0.630s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Lock "cinder-quobyte-eeec9d13-c8ce-46bb-8773-8584f295ee5d" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b01d3a-1981-4f5d-b1b1-62280911a2ae]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:21 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 Sep 11 21:23:21 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:22 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d Sep 11 21:23:22 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:22 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71" returned: 0 in 0.424s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-104edcd0-4937-4d0e-b269-c1e048c421ab req-adf9b394-a2a9-4015-99c6-c5951d9073cd tempest-TaggedAttachmentsTest-813279072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.086s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637e1e60-0a10-42d3-a6f6-7082aa07885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cbc818-0c4c-40f8-8347-6ef0ef6ce49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-104edcd0-4937-4d0e-b269-c1e048c421ab req-adf9b394-a2a9-4015-99c6-c5951d9073cd tempest-TaggedAttachmentsTest-813279072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:22 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Volume volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 (1f8dfc9c-cda5-4d32-81f1-230214ee1f71): created successfully Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cbc818-0c4c-40f8-8347-6ef0ef6ce49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Flow 'volume_create_manager' (6fe5b197-88dc-4abb-8a43-ad918257095d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:23:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cb292d73-3cbc-4494-b29b-53ec958b628b tempest-ServerRescueNegativeTestJSON-1742310228 None] Created volume successfully. Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-104edcd0-4937-4d0e-b269-c1e048c421ab req-adf9b394-a2a9-4015-99c6-c5951d9073cd tempest-TaggedAttachmentsTest-813279072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '830ce8b4-9bc5-459f-bc71-d846d43aa97e', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:23:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-104edcd0-4937-4d0e-b269-c1e048c421ab req-adf9b394-a2a9-4015-99c6-c5951d9073cd tempest-TaggedAttachmentsTest-813279072 None] attachment_update completed successfully. Sep 11 21:23:22 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d" returned: 0 in 0.867s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:22 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d Sep 11 21:23:22 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:23 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eeec9d13-c8ce-46bb-8773-8584f295ee5d" returned: 0 in 0.701s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Lock "cinder-quobyte-eeec9d13-c8ce-46bb-8773-8584f295ee5d" released by "delete_volume" :: held 1.659s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:23:23 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Created reservations ['570dfbcf-efc3-4db1-bb5e-7d8e1f53ba09'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:23:23 devstack cinder-volume[87423]: WARNING cinder.quota [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1078008104 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1078008104, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:23:23 devstack cinder-volume[87423]: WARNING cinder.quota [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1078008104 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1078008104, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:23:23 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Created reservations ['7492c821-03e7-4b48-8f06-e0088fb78b5d', '4246a77b-c2b9-4273-aa56-7eefab9dc205', '30145a1f-d58c-4f54-8f3e-8cb59d870a5a', '0b202495-a79b-4e86-9118-9c1b77cb7869'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:23:24 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Created reservations ['642930e9-8aa5-43c0-86c9-6c8b1849446d', '4c40dd3c-afdb-4436-8064-f430ae9063ca', '9795af4d-5725-4a52-ba3d-460c2fc879c8', 'f8293dfa-9864-42af-9a84-a1435115a95d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:23:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:24 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:23:24 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:25 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.825s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:25 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:23:25 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0eeec84b-7c50-4572-b63f-ea8a9d9799d8 tempest-GroupsTest-586612511 None] Delete group completed successfully. Sep 11 21:23:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-56461d31-1e23-4bca-86a0-4b4511a6c9b5 req-2133c57e-9fe9-4971-8ad6-e9059b3da74e tempest-TaggedAttachmentsTest-813279072 None] Terminate volume connection completed successfully. Sep 11 21:23:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-56461d31-1e23-4bca-86a0-4b4511a6c9b5 req-2133c57e-9fe9-4971-8ad6-e9059b3da74e tempest-TaggedAttachmentsTest-813279072 None] Deleting attachment 830ce8b4-9bc5-459f-bc71-d846d43aa97e. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:23:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2f70c0f7-485f-4dc3-bb70-ad87ab75a575 tempest-GroupsV320Test-473906372 None] Group tempest-GroupsV320Test-Group-1253533142: creating Sep 11 21:23:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2f70c0f7-485f-4dc3-bb70-ad87ab75a575 tempest-GroupsV320Test-473906372 None] Group tempest-GroupsV320Test-Group-1253533142: created successfully Sep 11 21:23:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2f70c0f7-485f-4dc3-bb70-ad87ab75a575 tempest-GroupsV320Test-473906372 None] Create group completed successfully. Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Acquiring lock "cinder-1f8dfc9c-cda5-4d32-81f1-230214ee1f71-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "cinder-1f8dfc9c-cda5-4d32-81f1-230214ee1f71-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Acquiring lock "cinder-quobyte-1f8dfc9c-cda5-4d32-81f1-230214ee1f71" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "cinder-quobyte-1f8dfc9c-cda5-4d32-81f1-230214ee1f71" acquired by "delete_volume" :: waited 0.040s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[953e291d-9908-4508-86fb-0f9265854efc]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:40 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 Sep 11 21:23:40 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] Created reservations ['b0a8ada5-8024-4e19-9396-8ae16103b1e0'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:40 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:23:40 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:41 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71" returned: 0 in 0.825s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:41 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71 Sep 11 21:23:41 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:41 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.697s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:41 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:23:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8e6e2c9a-6618-4d1d-b5f2-25b3e91c8f01 tempest-GroupsV320Test-473906372 None] Delete group completed successfully. Sep 11 21:23:41 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1f8dfc9c-cda5-4d32-81f1-230214ee1f71" returned: 0 in 0.589s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "cinder-quobyte-1f8dfc9c-cda5-4d32-81f1-230214ee1f71" released by "delete_volume" :: held 1.495s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:23:41 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Created reservations ['48357415-10af-4b45-b3b7-d15b4673b4c7', '54469509-aeb8-4615-a2e7-4ea8ab2a922b', '6d6cde8a-0f45-42e9-917a-eb366e9ca164', 'a9b74093-cf8e-4d59-9dcf-ddca9f312365'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:23:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:42 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:23:42 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:42 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.550s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:42 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:23:42 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Deleted volume successfully. Sep 11 21:23:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00dce61a-a16e-4659-a684-8bd17141c984 tempest-ServerRescueNegativeTestJSON-1742310228 None] Lock "cinder-1f8dfc9c-cda5-4d32-81f1-230214ee1f71-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:23:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Acquiring lock "cinder-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:23:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Lock "cinder-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:23:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Acquiring lock "cinder-quobyte-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:23:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Lock "cinder-quobyte-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:23:50 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[363e85e2-8229-4dad-bbec-be069d430f4e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:23:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:50 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 Sep 11 21:23:50 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:51 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2" returned: 0 in 0.448s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:51 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2 Sep 11 21:23:51 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:51 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2" returned: 0 in 0.315s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Lock "cinder-quobyte-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2" released by "delete_volume" :: held 0.819s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Created reservations ['e2bc3ac5-040c-4e8b-84fe-a1f7604eb325', '00094c88-b475-48b2-b34b-f03772faae3f', 'c1d37a3e-4bee-491c-8ab2-2c513f88dd77', 'd64b24c1-cc36-4dcb-998d-ad838f070f81'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:23:51 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:23:51 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:23:51 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.334s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:23:51 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:23:52 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Deleted volume successfully. Sep 11 21:23:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0e7dd3ca-14e9-4390-8f43-bf4f46361332 tempest-TaggedAttachmentsTest-813279072 None] Lock "cinder-63ddf5e1-9d86-4382-aa5a-7e27f373a4a2-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:01 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=66,cinder:SELECT=53,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=70,cinder:UPDATE=64,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Flow 'volume_create_manager' (6e35feff-f072-4ee0-8378-43fe4cce6243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91537683-9be5-4e12-ad36-061de7ee5348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91537683-9be5-4e12-ad36-061de7ee5348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1230638807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a71fbfd-f677-443d-8d6a-e73573178321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08371e0c8ba4ed8950e3506ac4b6f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:24:03Z,use_quota=True,user_id='43b3a50b5d60439db4c7f3a4d76b4c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d29902-9c48-47e5-877e-ec67c908eaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d29902-9c48-47e5-877e-ec67c908eaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baa43d8-5c87-46b2-b661-ca8a761f4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baa43d8-5c87-46b2-b661-ca8a761f4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a71fbfd-f677-443d-8d6a-e73573178321', 'volume_name': 'volume-0a71fbfd-f677-443d-8d6a-e73573178321', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2401486-63ae-4e3f-a388-2e594d18f147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2401486-63ae-4e3f-a388-2e594d18f147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ff86e7-d579-4882-83e1-6369ac551fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:02 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Volume 0a71fbfd-f677-443d-8d6a-e73573178321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a71fbfd-f677-443d-8d6a-e73573178321', 'volume_size': 1} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1230638807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a71fbfd-f677-443d-8d6a-e73573178321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08371e0c8ba4ed8950e3506ac4b6f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:24:03Z,use_quota=True,user_id='43b3a50b5d60439db4c7f3a4d76b4c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Creating volume 0a71fbfd-f677-443d-8d6a-e73573178321 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:24:02 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:24:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:03 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321 1073741824 Sep 11 21:24:03 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:03 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321 1073741824" returned: 0 in 0.653s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:03 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321 Sep 11 21:24:03 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:04 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321" returned: 0 in 0.429s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:24:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ff86e7-d579-4882-83e1-6369ac551fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a71fbfd-f677-443d-8d6a-e73573178321', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca1bf54-22d9-4b98-b24e-afade423c395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Volume volume-0a71fbfd-f677-443d-8d6a-e73573178321 (0a71fbfd-f677-443d-8d6a-e73573178321): created successfully Sep 11 21:24:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca1bf54-22d9-4b98-b24e-afade423c395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Flow 'volume_create_manager' (6e35feff-f072-4ee0-8378-43fe4cce6243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:24:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8d741b7a-e486-4e96-8c17-725928757c08 tempest-DeleteServersTestJSON-1882210160 None] Created volume successfully. Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Flow 'volume_create_manager' (e1ba6f17-12ca-450a-b881-5d7398b8df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4978715c-36c8-4a96-a83c-8fc0f3fb05ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4978715c-36c8-4a96-a83c-8fc0f3fb05ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2086458287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e475a68c-08a7-4508-bff5-75546d40f476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1f5f563e904d3eb882575747d4673a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:24:06Z,use_quota=True,user_id='7707306cc8304344b7a283aff13bb165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dc3223-52c5-4766-8f7c-b549056fcb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dc3223-52c5-4766-8f7c-b549056fcb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd4197b-9b17-467a-9a9f-3479b9b95b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd4197b-9b17-467a-9a9f-3479b9b95b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e475a68c-08a7-4508-bff5-75546d40f476', 'volume_name': 'volume-e475a68c-08a7-4508-bff5-75546d40f476', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d02e6a1-9683-49e2-ae8b-e5779787d6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d02e6a1-9683-49e2-ae8b-e5779787d6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681f8f3c-243f-4562-b591-9db7fbb4aea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:05 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Volume e475a68c-08a7-4508-bff5-75546d40f476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e475a68c-08a7-4508-bff5-75546d40f476', 'volume_size': 1} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2086458287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e475a68c-08a7-4508-bff5-75546d40f476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1f5f563e904d3eb882575747d4673a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:24:06Z,use_quota=True,user_id='7707306cc8304344b7a283aff13bb165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Creating volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:24:05 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:24:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:06 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 1073741824 Sep 11 21:24:06 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-523a2cec-3d35-4870-bb61-bef15f39dbe5 req-b8ebad04-1cca-4e29-8f4f-17911b3ecff6 tempest-DeleteServersTestJSON-1882210160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:06 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 1073741824" returned: 0 in 0.738s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:06 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 Sep 11 21:24:06 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:07 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476" returned: 0 in 0.530s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-523a2cec-3d35-4870-bb61-bef15f39dbe5 req-b8ebad04-1cca-4e29-8f4f-17911b3ecff6 tempest-DeleteServersTestJSON-1882210160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.880s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681f8f3c-243f-4562-b591-9db7fbb4aea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e475a68c-08a7-4508-bff5-75546d40f476', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c8ea3b-6e26-489f-b675-e693b2c3d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-523a2cec-3d35-4870-bb61-bef15f39dbe5 req-b8ebad04-1cca-4e29-8f4f-17911b3ecff6 tempest-DeleteServersTestJSON-1882210160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Volume volume-e475a68c-08a7-4508-bff5-75546d40f476 (e475a68c-08a7-4508-bff5-75546d40f476): created successfully Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c8ea3b-6e26-489f-b675-e693b2c3d31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Flow 'volume_create_manager' (e1ba6f17-12ca-450a-b881-5d7398b8df06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:24:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b725656c-89c8-4524-99f9-9a9ea74d2310 tempest-SnapshotsActionsTest-783046736 None] Created volume successfully. Sep 11 21:24:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-523a2cec-3d35-4870-bb61-bef15f39dbe5 req-b8ebad04-1cca-4e29-8f4f-17911b3ecff6 tempest-DeleteServersTestJSON-1882210160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-0a71fbfd-f677-443d-8d6a-e73573178321', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4525a06-0990-4725-8e4f-9f635400f9c9', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:24:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-523a2cec-3d35-4870-bb61-bef15f39dbe5 req-b8ebad04-1cca-4e29-8f4f-17911b3ecff6 tempest-DeleteServersTestJSON-1882210160 None] attachment_update completed successfully. Sep 11 21:24:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Creating offline snapshot 4e159323-f5ea-499d-95f2-b3a51f816c77 of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:24:08 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc6c5c-86cc-4298-819d-3215ecc74d16]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:08 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 Sep 11 21:24:08 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:08 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476" returned: 0 in 0.591s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:08 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 1G Sep 11 21:24:08 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:09 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 1G" returned: 0 in 0.904s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:09 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:09 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:10 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.606s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:10 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 is being set with open permissions: ugo+rw Sep 11 21:24:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:10 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:10 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:10 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.420s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:10 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.info Sep 11 21:24:10 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:11 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.info" returned: 0 in 0.444s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:11 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.info is being set with open permissions: ugo+rw Sep 11 21:24:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:11 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.info Sep 11 21:24:11 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:11 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.info" returned: 0 in 0.298s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.439s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-48b63afd-d31d-401d-a6c8-1b96a824b9c4 tempest-SnapshotsActionsTest-783046736 None] Create snapshot completed successfully Sep 11 21:24:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-141d21c3-fc30-420b-8456-681a2be95d0f req-70d9d2e9-e48a-40df-a1b5-73e9bd937708 tempest-DeleteServersTestJSON-1882210160 None] Terminate volume connection completed successfully. Sep 11 21:24:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-141d21c3-fc30-420b-8456-681a2be95d0f req-70d9d2e9-e48a-40df-a1b5-73e9bd937708 tempest-DeleteServersTestJSON-1882210160 None] Deleting attachment c4525a06-0990-4725-8e4f-9f635400f9c9. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:24:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Creating offline snapshot 84868329-3467-42cf-837c-2591ed52f4c1 of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:24:13 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[016d2720-8d17-4b6a-b626-e2bce2073362]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:13 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:13 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:13 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.433s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:13 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 1G Sep 11 21:24:13 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:14 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 1G" returned: 0 in 0.557s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:14 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 Sep 11 21:24:14 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Acquiring lock "cinder-0a71fbfd-f677-443d-8d6a-e73573178321-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Lock "cinder-0a71fbfd-f677-443d-8d6a-e73573178321-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:14 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1" returned: 0 in 0.450s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:14 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 is being set with open permissions: ugo+rw Sep 11 21:24:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:14 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 Sep 11 21:24:14 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Acquiring lock "cinder-quobyte-0a71fbfd-f677-443d-8d6a-e73573178321" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Lock "cinder-quobyte-0a71fbfd-f677-443d-8d6a-e73573178321" acquired by "delete_volume" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c575bc9e-40ff-48c9-823b-cac6ee43686f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:15 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321 Sep 11 21:24:15 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:15 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:15 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-701a07bf-015b-4ad8-8c5a-41115ff3cd62 tempest-SnapshotsActionsTest-783046736 None] Create snapshot completed successfully Sep 11 21:24:15 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321" returned: 0 in 0.583s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:15 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321 Sep 11 21:24:15 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-84868329-3467-42cf-837c-2591ed52f4c1-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:15 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:24:15 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-84868329-3467-42cf-837c-2591ed52f4c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-quobyte-84868329-3467-42cf-837c-2591ed52f4c1" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-84868329-3467-42cf-837c-2591ed52f4c1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Deleting offline snapshot 84868329-3467-42cf-837c-2591ed52f4c1 of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] snapshot_file for this snap is: volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[82899c47-bc20-4788-998a-c671c66cff6b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:16 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0a71fbfd-f677-443d-8d6a-e73573178321" returned: 0 in 0.438s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Lock "cinder-quobyte-0a71fbfd-f677-443d-8d6a-e73573178321" released by "delete_volume" :: held 1.088s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:16 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 Sep 11 21:24:16 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:16 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.454s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 8 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Created reservations ['d4a3b00b-1b6f-4f18-89d7-c6812065957c', '914ef990-850c-4045-8286-34d85da58948', 'a2e82fe3-758d-4786-abcb-cb390492e5b4', '1a3dee33-e1d9-4b45-939a-5d4334368ac1'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:16 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:24:16 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:16 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1" returned: 0 in 0.580s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2bbcfd-676d-4c53-88fd-60e62d25185d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:16 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.355s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:24:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Deleted volume successfully. Sep 11 21:24:16 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:16 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4f79a53e-7006-48fb-abbe-c798a2e3f06d tempest-DeleteServersTestJSON-1882210160 None] Lock "cinder-0a71fbfd-f677-443d-8d6a-e73573178321-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:17 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.478s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:17 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 Sep 11 21:24:17 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:17 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1" returned: 0 in 0.480s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:17 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1 Sep 11 21:24:17 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:17 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.84868329-3467-42cf-837c-2591ed52f4c1" returned: 0 in 0.272s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-84868329-3467-42cf-837c-2591ed52f4c1" released by "_delete_snapshot" :: held 1.931s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" released by "delete_snapshot" :: held 1.956s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:17 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Created reservations ['bfdef2d2-149f-43ae-9e61-63a3f13d5d69', 'd4113ec3-0b80-4fd6-b497-77b59b9f9a46', '75e8d354-ea9b-4bdf-97ae-3f56f36a8497', '255ae1d2-3590-4ab3-9c8c-62b39360f802'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:24:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Delete snapshot completed successfully. Sep 11 21:24:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4fd7494-f3e1-4885-ab1a-522caf2538d6 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-84868329-3467-42cf-837c-2591ed52f4c1-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Creating offline snapshot 4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:24:18 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f6c26-8e2e-4af1-8815-16008f79958e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:18 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:18 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:18 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.417s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:18 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 1G Sep 11 21:24:18 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:19 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 1G" returned: 0 in 0.614s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:19 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 Sep 11 21:24:19 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:19 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86" returned: 0 in 0.388s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:19 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 is being set with open permissions: ugo+rw Sep 11 21:24:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:19 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 Sep 11 21:24:19 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:20 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86" returned: 0 in 0.360s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:20 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2acfe93b-e38c-46a1-97dc-7c9350d034e8 tempest-SnapshotsActionsTest-783046736 None] Create snapshot completed successfully Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-4c3cae2a-cbfe-4628-98ba-e60f06a7ca86-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-4c3cae2a-cbfe-4628-98ba-e60f06a7ca86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-quobyte-4c3cae2a-cbfe-4628-98ba-e60f06a7ca86" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-4c3cae2a-cbfe-4628-98ba-e60f06a7ca86" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Deleting offline snapshot 4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] snapshot_file for this snap is: volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dfd162-8246-47cf-973e-ca3b69d05ef7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:20 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 Sep 11 21:24:20 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:21 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86" returned: 0 in 0.442s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:21 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcec3529-5783-46e9-b5c2-4eeef34f178e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:21 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:21 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:21 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.418s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:21 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 Sep 11 21:24:21 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:22 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86" returned: 0 in 0.501s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:22 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86 Sep 11 21:24:22 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:22 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4c3cae2a-cbfe-4628-98ba-e60f06a7ca86" returned: 0 in 0.274s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-4c3cae2a-cbfe-4628-98ba-e60f06a7ca86" released by "_delete_snapshot" :: held 1.760s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" released by "delete_snapshot" :: held 1.793s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:22 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Created reservations ['592fa140-6343-49fe-bfcb-d6371d0db7ae', 'c2a8c79c-cfbc-4bf9-9589-a5f73590beb6', '92f99496-eff1-404d-9eba-f5fa72e2faa5', 'c21b1c4a-ff23-42a4-ac6a-cc6ad468e2c6'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:24:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Delete snapshot completed successfully. Sep 11 21:24:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c7f2641a-4318-4495-9d50-072e6cb6ad79 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-4c3cae2a-cbfe-4628-98ba-e60f06a7ca86-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Creating offline snapshot ea3b102f-5938-46ca-ad67-c4b0adcd2a9a of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:24:23 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6fbe8b-8106-48ec-a3bd-e432bc77b6bd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:23 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:23 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:23 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.394s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:23 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a 1G Sep 11 21:24:23 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:24 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a 1G" returned: 0 in 0.560s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:24 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a Sep 11 21:24:24 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:24 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a" returned: 0 in 0.341s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:24 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a is being set with open permissions: ugo+rw Sep 11 21:24:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:24 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a Sep 11 21:24:24 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:24 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a" returned: 0 in 0.295s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.719s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:25 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-be48e774-b349-43e7-a5ca-2ae9d1b18325 tempest-SnapshotsActionsTest-783046736 None] Create snapshot completed successfully Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-ea3b102f-5938-46ca-ad67-c4b0adcd2a9a-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-ea3b102f-5938-46ca-ad67-c4b0adcd2a9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-quobyte-ea3b102f-5938-46ca-ad67-c4b0adcd2a9a" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-ea3b102f-5938-46ca-ad67-c4b0adcd2a9a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Deleting offline snapshot ea3b102f-5938-46ca-ad67-c4b0adcd2a9a of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] snapshot_file for this snap is: volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8c1688-9190-431c-b6dd-3e89a54f66a9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:25 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a Sep 11 21:24:25 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:26 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a" returned: 0 in 0.504s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:26 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f610ef8b-fe17-4c83-b29c-48b3d839b359]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:26 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:26 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:26 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.526s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:26 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a Sep 11 21:24:26 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:27 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a" returned: 0 in 0.605s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:27 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a Sep 11 21:24:27 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:27 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.ea3b102f-5938-46ca-ad67-c4b0adcd2a9a" returned: 0 in 0.371s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-ea3b102f-5938-46ca-ad67-c4b0adcd2a9a" released by "_delete_snapshot" :: held 2.137s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" released by "delete_snapshot" :: held 2.175s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:27 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Created reservations ['9fb7a5f7-e7ab-40c0-b5d2-3ababe0abcae', '245a0a3a-75bf-4f5f-a3b9-479e98043722', 'e11b8bb7-70e4-48cc-b328-a34e2814b22e', '159d85d0-d0ec-434c-a22c-a3ac7ee029ab'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:24:28 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Delete snapshot completed successfully. Sep 11 21:24:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2954dc0d-d0f1-41f2-b885-1ae071631995 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-ea3b102f-5938-46ca-ad67-c4b0adcd2a9a-delete_snapshot" released by "delete_snapshot" :: held 2.483s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Creating offline snapshot f9e23cde-0257-4169-b716-34988ab416c8 of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:24:29 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d0da8d-7405-4cfa-959a-6c27d3eea5c6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:29 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:29 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:29 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.450s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:29 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 1G Sep 11 21:24:29 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:30 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 1G" returned: 0 in 0.477s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:30 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 Sep 11 21:24:30 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:30 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8" returned: 0 in 0.326s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:30 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 is being set with open permissions: ugo+rw Sep 11 21:24:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:30 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 Sep 11 21:24:30 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:30 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.695s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-287a9071-cbc4-4766-9160-d7f63062593e tempest-SnapshotsActionsTest-783046736 None] Create snapshot completed successfully Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-f9e23cde-0257-4169-b716-34988ab416c8-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-f9e23cde-0257-4169-b716-34988ab416c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Acquiring lock "cinder-quobyte-f9e23cde-0257-4169-b716-34988ab416c8" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-f9e23cde-0257-4169-b716-34988ab416c8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Deleting offline snapshot f9e23cde-0257-4169-b716-34988ab416c8 of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] snapshot_file for this snap is: volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a659161-d4f4-48d2-b763-3105c6ec71d6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:31 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 Sep 11 21:24:31 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:32 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8" returned: 0 in 0.377s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:32 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1435d1c6-ccd6-41c3-8442-657b1c7c1029]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:32 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:32 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:32 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.395s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:32 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 Sep 11 21:24:32 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:32 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8" returned: 0 in 0.522s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:33 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8 Sep 11 21:24:33 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:33 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.f9e23cde-0257-4169-b716-34988ab416c8" returned: 0 in 0.260s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-f9e23cde-0257-4169-b716-34988ab416c8" released by "_delete_snapshot" :: held 1.670s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" released by "delete_snapshot" :: held 1.700s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:33 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Created reservations ['2e9b8735-0c5b-4f55-977a-c0716a7fffe2', '617a8735-2edf-486a-8057-160f6140d469', 'a1a0d87d-2faf-47da-aa24-62e76e09d371', '40e05425-b3b9-4257-b750-00175810dc6d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:24:33 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Delete snapshot completed successfully. Sep 11 21:24:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0ced409-0d26-41fa-a813-1a3dd4c98b48 tempest-SnapshotsActionsTest-324444616 None] Lock "cinder-f9e23cde-0257-4169-b716-34988ab416c8-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "cinder-4e159323-f5ea-499d-95f2-b3a51f816c77-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-4e159323-f5ea-499d-95f2-b3a51f816c77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "cinder-quobyte-4e159323-f5ea-499d-95f2-b3a51f816c77" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-quobyte-4e159323-f5ea-499d-95f2-b3a51f816c77" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Deleting offline snapshot 4e159323-f5ea-499d-95f2-b3a51f816c77 of volume e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] snapshot_file for this snap is: volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e62ec2e-2fd3-40c7-98ed-c26b17523d37]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:34 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:34 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:35 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.882s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475a68c-08a7-4508-bff5-75546d40f476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:24:35 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d943ae8-e172-4ca6-bd7a-26eb330a9a9f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:35 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 Sep 11 21:24:35 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:36 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476" returned: 0 in 0.679s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:36 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:36 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:36 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.739s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:36 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77 Sep 11 21:24:37 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:37 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476.4e159323-f5ea-499d-95f2-b3a51f816c77" returned: 0 in 0.607s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-quobyte-4e159323-f5ea-499d-95f2-b3a51f816c77" released by "_delete_snapshot" :: held 3.199s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" released by "delete_snapshot" :: held 3.265s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:37 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Created reservations ['49e9ff5c-d9b1-4840-a502-1e537b81c099', '263ddb93-b9e9-43cd-86e1-8b33665d4664', 'f94bcc21-db3c-448c-bc55-4430cb8bb3c6', '77b487e4-ee33-4089-9b73-36a2a7d5994a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:24:37 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Delete snapshot completed successfully. Sep 11 21:24:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-86939f63-fb2b-4939-b32e-54aff8042d3e tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-4e159323-f5ea-499d-95f2-b3a51f816c77-delete_snapshot" released by "delete_snapshot" :: held 3.607s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "cinder-e475a68c-08a7-4508-bff5-75546d40f476-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-e475a68c-08a7-4508-bff5-75546d40f476-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:24:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" acquired by "delete_volume" :: waited 0.042s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:24:39 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6320683-2c2b-4cc8-9899-d096fd684467]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:24:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:39 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 Sep 11 21:24:39 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:39 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476" returned: 0 in 0.505s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:39 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476 Sep 11 21:24:39 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:39 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e475a68c-08a7-4508-bff5-75546d40f476" returned: 0 in 0.471s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-quobyte-e475a68c-08a7-4508-bff5-75546d40f476" released by "delete_volume" :: held 1.074s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Created reservations ['685eea33-78fa-4ff2-b087-221b233dfa00', '3f378808-6bbd-45a1-8248-c794bcdde02b', '5ede55cf-3f34-4174-b054-4ed29c74fcff', '8e1244c2-7060-4d39-858b-4b66ae1a920d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:24:40 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:24:40 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:24:40 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.367s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:24:40 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Deleted volume successfully. Sep 11 21:24:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d44945b6-38d4-4ecd-b212-d4bb1a8b0544 tempest-SnapshotsActionsTest-783046736 None] Lock "cinder-e475a68c-08a7-4508-bff5-75546d40f476-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:24:50 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=62,cinder:UPDATE=59,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:24:50 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=55,cinder:UPDATE=54,cinder:DELETE=3,cinder:INSERT=16 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Flow 'volume_create_manager' (0b58b988-296d-432a-9c08-37dff21df869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8439b6d-c8ed-4c8e-bdab-ac110159d4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8439b6d-c8ed-4c8e-bdab-ac110159d4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2033349875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5402b457-e9a2-49fe-b2da-4aad92fa3419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ddfacbb9e4f7cb2c22ef05d5596d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:02Z,use_quota=True,user_id='93000d07ee9e4d93b7eec00a6d313af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1baf0acb-a0f7-46f7-959f-9f233208abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1baf0acb-a0f7-46f7-959f-9f233208abfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c6d545-320e-48bc-9e80-da92ba5e179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c6d545-320e-48bc-9e80-da92ba5e179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5402b457-e9a2-49fe-b2da-4aad92fa3419', 'volume_name': 'volume-5402b457-e9a2-49fe-b2da-4aad92fa3419', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4e4e21-2f97-4012-b626-3dd51f0b6015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4e4e21-2f97-4012-b626-3dd51f0b6015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8384bef9-56f4-411f-b299-21966ef5fe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:02 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Volume 5402b457-e9a2-49fe-b2da-4aad92fa3419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5402b457-e9a2-49fe-b2da-4aad92fa3419', 'volume_size': 1} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2033349875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5402b457-e9a2-49fe-b2da-4aad92fa3419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ddfacbb9e4f7cb2c22ef05d5596d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:02Z,use_quota=True,user_id='93000d07ee9e4d93b7eec00a6d313af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Creating volume 5402b457-e9a2-49fe-b2da-4aad92fa3419 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:25:02 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:02 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 1073741824 Sep 11 21:25:02 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:02 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 1073741824" returned: 0 in 0.530s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:02 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 Sep 11 21:25:02 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:03 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:25:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8384bef9-56f4-411f-b299-21966ef5fe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5402b457-e9a2-49fe-b2da-4aad92fa3419', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd678c4-0492-427b-9c87-8e7eba3d663c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:03 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Volume volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 (5402b457-e9a2-49fe-b2da-4aad92fa3419): created successfully Sep 11 21:25:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd678c4-0492-427b-9c87-8e7eba3d663c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Flow 'volume_create_manager' (0b58b988-296d-432a-9c08-37dff21df869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a3320953-a52e-4c33-be5f-d5dfcd1a3983 tempest-ServersNegativeTestJSON-854113582 None] Created volume successfully. Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Flow 'volume_create_manager' (028e9399-1768-4e4f-9a7d-ffe41b6e0f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b38fb30-eb09-4289-b455-e6466ba35d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b38fb30-eb09-4289-b455-e6466ba35d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-632419037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7e9a06-6014-4bac-9dfb-97d5341cf8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ddfacbb9e4f7cb2c22ef05d5596d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:06Z,use_quota=True,user_id='93000d07ee9e4d93b7eec00a6d313af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f10ff7-98c8-4fe0-b3be-e2bb51ca69d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f10ff7-98c8-4fe0-b3be-e2bb51ca69d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136a0475-a84b-426f-9cee-0579f4d68e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136a0475-a84b-426f-9cee-0579f4d68e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c7e9a06-6014-4bac-9dfb-97d5341cf8e9', 'volume_name': 'volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc47550-802a-4564-81fa-f7117bd88031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc47550-802a-4564-81fa-f7117bd88031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd38d389-f58f-4b50-919a-10659e06e634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:06 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Volume 4c7e9a06-6014-4bac-9dfb-97d5341cf8e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9', 'volume_size': 1} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-632419037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7e9a06-6014-4bac-9dfb-97d5341cf8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ddfacbb9e4f7cb2c22ef05d5596d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:06Z,use_quota=True,user_id='93000d07ee9e4d93b7eec00a6d313af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Creating volume 4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:25:06 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:25:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:06 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 1073741824 Sep 11 21:25:06 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:07 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 1073741824" returned: 0 in 0.809s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:07 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 Sep 11 21:25:07 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:07 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9" returned: 0 in 0.528s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:25:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd38d389-f58f-4b50-919a-10659e06e634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a68dfd-d45f-448f-9672-71a48ba79705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Volume volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 (4c7e9a06-6014-4bac-9dfb-97d5341cf8e9): created successfully Sep 11 21:25:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a68dfd-d45f-448f-9672-71a48ba79705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Flow 'volume_create_manager' (028e9399-1768-4e4f-9a7d-ffe41b6e0f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:08 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cbe6bc05-b9f2-4715-8613-4b27212d8e79 tempest-ServersNegativeTestJSON-854113582 None] Created volume successfully. Sep 11 21:25:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "cinder-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:25:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Lock "cinder-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:25:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "cinder-quobyte-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:25:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Lock "cinder-quobyte-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:25:09 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cc6e46-8419-46d4-852e-543cdc238063]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:25:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:09 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 Sep 11 21:25:09 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:10 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9" returned: 0 in 0.504s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:10 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9 Sep 11 21:25:10 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:10 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9" returned: 0 in 0.298s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Lock "cinder-quobyte-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9" released by "delete_volume" :: held 0.875s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Created reservations ['527174ba-22bf-47e0-99c7-2a3934695e08', '33dceb86-bb40-425d-bdad-7a0c6b28d2de', '88f19f58-fbf6-4d3f-b9e4-0a5c3b4e0ff5', '5b5e5b59-f8d7-4795-9646-a47ab92448fb'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:10 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:25:10 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "cinder-5402b457-e9a2-49fe-b2da-4aad92fa3419-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Lock "cinder-5402b457-e9a2-49fe-b2da-4aad92fa3419-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "cinder-quobyte-5402b457-e9a2-49fe-b2da-4aad92fa3419" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Lock "cinder-quobyte-5402b457-e9a2-49fe-b2da-4aad92fa3419" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b62a189-9831-46a7-bb41-48a463dbd0af]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:25:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:11 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.364s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:25:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Deleted volume successfully. Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa4ccbbd-bea7-450a-be61-987a28665766 tempest-ServersNegativeTestJSON-854113582 None] Lock "cinder-4c7e9a06-6014-4bac-9dfb-97d5341cf8e9-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:25:11 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 Sep 11 21:25:11 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:11 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419" returned: 0 in 0.446s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:11 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419 Sep 11 21:25:11 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:11 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5402b457-e9a2-49fe-b2da-4aad92fa3419" returned: 0 in 0.318s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Lock "cinder-quobyte-5402b457-e9a2-49fe-b2da-4aad92fa3419" released by "delete_volume" :: held 0.812s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Created reservations ['eaec0d8f-b3a1-4680-9ff9-c75ef47ea88c', 'b6b14f3e-eb12-4e85-9313-fac378e7ba4f', 'a4a4900a-fc31-4049-a576-a900c1279070', '405d6270-23f0-4e19-b707-97db299aad5b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:11 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:25:11 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:12 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.446s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:25:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Deleted volume successfully. Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2aca4496-0ace-479d-9b6b-978fc59f1f0a tempest-ServersNegativeTestJSON-854113582 None] Lock "cinder-5402b457-e9a2-49fe-b2da-4aad92fa3419-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Flow 'volume_create_manager' (d4bb2087-f7af-407e-9612-cd0e6488ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b24c86-1c4d-4573-9d25-295889c2f3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b24c86-1c4d-4573-9d25-295889c2f3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1271176380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48effd5e-1c7a-470e-acee-430bc352c80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6597057d75b47e49f48acf1c7f32de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:13Z,use_quota=True,user_id='1a482fd14e304ddc895c128714b3aa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309e70a5-cd16-4c3b-aada-885ea06a8e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309e70a5-cd16-4c3b-aada-885ea06a8e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08c0846-aef2-4bac-96f1-972000c72f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08c0846-aef2-4bac-96f1-972000c72f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48effd5e-1c7a-470e-acee-430bc352c80b', 'volume_name': 'volume-48effd5e-1c7a-470e-acee-430bc352c80b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe615ea-ad9a-46c0-aef4-f4b8178db538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe615ea-ad9a-46c0-aef4-f4b8178db538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53095113-01a9-41d4-af7d-6fd555fe48e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:12 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Volume 48effd5e-1c7a-470e-acee-430bc352c80b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48effd5e-1c7a-470e-acee-430bc352c80b', 'volume_size': 1} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1271176380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48effd5e-1c7a-470e-acee-430bc352c80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6597057d75b47e49f48acf1c7f32de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:13Z,use_quota=True,user_id='1a482fd14e304ddc895c128714b3aa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Creating volume 48effd5e-1c7a-470e-acee-430bc352c80b {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:25:12 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:25:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:12 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b 1073741824 Sep 11 21:25:12 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:13 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b 1073741824" returned: 0 in 0.916s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:13 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b Sep 11 21:25:13 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:14 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b" returned: 0 in 0.460s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:25:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53095113-01a9-41d4-af7d-6fd555fe48e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48effd5e-1c7a-470e-acee-430bc352c80b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba328a76-a6ac-4b42-941e-493bdb4b4157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:14 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Volume volume-48effd5e-1c7a-470e-acee-430bc352c80b (48effd5e-1c7a-470e-acee-430bc352c80b): created successfully Sep 11 21:25:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba328a76-a6ac-4b42-941e-493bdb4b4157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Flow 'volume_create_manager' (d4bb2087-f7af-407e-9612-cd0e6488ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:14 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f7230dfd-9133-4519-825b-324de982bfcd tempest-AttachVolumeTestJSON-680445976 None] Created volume successfully. Sep 11 21:25:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:25:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:15 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:25:15 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:16 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.352s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:25:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:25:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 8 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:25:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:25:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-fccbbb6b-47b9-4c74-8392-9b5a3e00e116 req-8d17cde2-686a-4764-a5a3-e4044a731a7d tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-fccbbb6b-47b9-4c74-8392-9b5a3e00e116 req-8d17cde2-686a-4764-a5a3-e4044a731a7d tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-fccbbb6b-47b9-4c74-8392-9b5a3e00e116 req-8d17cde2-686a-4764-a5a3-e4044a731a7d tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-fccbbb6b-47b9-4c74-8392-9b5a3e00e116 req-8d17cde2-686a-4764-a5a3-e4044a731a7d tempest-AttachVolumeTestJSON-680445976 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-48effd5e-1c7a-470e-acee-430bc352c80b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b545b8c-dd74-4e27-aa4d-d8d485b2ed9b', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:25:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-fccbbb6b-47b9-4c74-8392-9b5a3e00e116 req-8d17cde2-686a-4764-a5a3-e4044a731a7d tempest-AttachVolumeTestJSON-680445976 None] attachment_update completed successfully. Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Flow 'volume_create_manager' (2413d2cd-430b-44ca-ab7c-c92c923bb6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf31932d-90ef-4adc-8f1a-5216dd2a3d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf31932d-90ef-4adc-8f1a-5216dd2a3d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1709999870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db3a59a-22cf-4990-9de7-0bcf91781686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1b7c548d6a457ab1fa45c1ba807f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:17Z,use_quota=True,user_id='ee2dede206bd4e48864a53e0102f463a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f7c4f5-64bb-4c7c-b016-45f3629e8dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f7c4f5-64bb-4c7c-b016-45f3629e8dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf65eb8-124b-4191-a09f-89c763ee54b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf65eb8-124b-4191-a09f-89c763ee54b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db3a59a-22cf-4990-9de7-0bcf91781686', 'volume_name': 'volume-4db3a59a-22cf-4990-9de7-0bcf91781686', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46679866-1388-47b8-b552-e56bb852aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46679866-1388-47b8-b552-e56bb852aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60ea6dc-20aa-4d7b-9fda-0a8f9b6b9210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:17 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Volume 4db3a59a-22cf-4990-9de7-0bcf91781686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db3a59a-22cf-4990-9de7-0bcf91781686', 'volume_size': 1} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1709999870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db3a59a-22cf-4990-9de7-0bcf91781686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1b7c548d6a457ab1fa45c1ba807f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:17Z,use_quota=True,user_id='ee2dede206bd4e48864a53e0102f463a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Creating volume 4db3a59a-22cf-4990-9de7-0bcf91781686 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:25:17 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:17 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686 1073741824 Sep 11 21:25:17 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:17 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686 1073741824" returned: 0 in 0.653s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:17 devstack sudo[91984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686 Sep 11 21:25:17 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:18 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686" returned: 0 in 0.325s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:25:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60ea6dc-20aa-4d7b-9fda-0a8f9b6b9210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db3a59a-22cf-4990-9de7-0bcf91781686', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d023d0a-ab23-4013-a89a-692e3eaf741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:18 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Volume volume-4db3a59a-22cf-4990-9de7-0bcf91781686 (4db3a59a-22cf-4990-9de7-0bcf91781686): created successfully Sep 11 21:25:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d023d0a-ab23-4013-a89a-692e3eaf741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Flow 'volume_create_manager' (2413d2cd-430b-44ca-ab7c-c92c923bb6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:18 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cc0e7389-55df-433c-b500-bd0f3789c8ff tempest-VolumeQuotasNegativeTestJSON-838669284 None] Created volume successfully. Sep 11 21:25:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Acquiring lock "cinder-4db3a59a-22cf-4990-9de7-0bcf91781686-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:25:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "cinder-4db3a59a-22cf-4990-9de7-0bcf91781686-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:25:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Acquiring lock "cinder-quobyte-4db3a59a-22cf-4990-9de7-0bcf91781686" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:25:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "cinder-quobyte-4db3a59a-22cf-4990-9de7-0bcf91781686" acquired by "delete_volume" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:25:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[194abc29-adb5-4a3e-ab51-f4270e295de0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:25:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:20 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686 Sep 11 21:25:20 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:20 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686" returned: 0 in 0.484s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:20 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686 Sep 11 21:25:20 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:21 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4db3a59a-22cf-4990-9de7-0bcf91781686" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "cinder-quobyte-4db3a59a-22cf-4990-9de7-0bcf91781686" released by "delete_volume" :: held 0.837s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Created reservations ['93a80a6c-04aa-46a8-9cc0-7a0ac75ea3ea', '2ca3431a-1c5f-48eb-b418-405125860773', '2a780c35-dd7c-4bce-b223-295df4516b93', '1b9bb5ce-36f5-43fc-89a1-0d7ccfbc2aad'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:21 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:25:21 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:21 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.558s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:21 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:25:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Deleted volume successfully. Sep 11 21:25:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc1afe2c-5d59-4a2e-91fc-b595e4fa2ba4 tempest-VolumeQuotasNegativeTestJSON-838669284 None] Lock "cinder-4db3a59a-22cf-4990-9de7-0bcf91781686-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:25:30 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:25:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Flow 'volume_create_manager' (bb03d6e8-639d-4a57-87aa-cf7a104fb2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e349e8d-928c-437b-9177-384ffabc6189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e349e8d-928c-437b-9177-384ffabc6189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-809719044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92aaf0d0-2caf-4378-bcb4-41241a5c284c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d1ac630f984f00b0358e3cdb021c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:31Z,use_quota=True,user_id='7c1bc7830d9a47d6bd75e63aa6d5bd82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f442a287-c587-449d-a1eb-02f10dfefc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f442a287-c587-449d-a1eb-02f10dfefc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df894a4-5821-4f30-be5b-bda4112b8b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df894a4-5821-4f30-be5b-bda4112b8b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92aaf0d0-2caf-4378-bcb4-41241a5c284c', 'volume_name': 'volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9cc45b-10bc-4093-bda7-8bf7f2de4c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9cc45b-10bc-4093-bda7-8bf7f2de4c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6df02-0090-473c-8fa1-2ba466fcef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:31 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Volume 92aaf0d0-2caf-4378-bcb4-41241a5c284c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c', 'volume_size': 1} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-809719044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92aaf0d0-2caf-4378-bcb4-41241a5c284c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d1ac630f984f00b0358e3cdb021c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:31Z,use_quota=True,user_id='7c1bc7830d9a47d6bd75e63aa6d5bd82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Creating volume 92aaf0d0-2caf-4378-bcb4-41241a5c284c {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:25:31 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:31 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c 1073741824 Sep 11 21:25:31 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:31 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c 1073741824" returned: 0 in 0.619s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:31 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c Sep 11 21:25:31 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:32 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c" returned: 0 in 0.411s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6df02-0090-473c-8fa1-2ba466fcef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5781926f-8051-44d9-b4d5-6df321bf19e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:32 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Volume volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c (92aaf0d0-2caf-4378-bcb4-41241a5c284c): created successfully Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5781926f-8051-44d9-b4d5-6df321bf19e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Flow 'volume_create_manager' (bb03d6e8-639d-4a57-87aa-cf7a104fb2d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:32 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2bb80627-a7d7-4b38-bc72-f306a672e9ac tempest-VolumesServicesTestJSON-1446362563 None] Created volume successfully. Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Flow 'volume_create_manager' (398c825f-5ca8-4ec0-acdc-acb0d45560f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bed9cbc-1663-4b34-af6d-1ea1d368da05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bed9cbc-1663-4b34-af6d-1ea1d368da05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1696183922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a780032e-f576-477c-a0ad-859b8615923a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0eae96c8294a7393201626f08b1c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:32Z,use_quota=True,user_id='d4a2994ae89d4135af51a131f5a320d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74160205-c304-4e42-b2e6-458e2ecc00d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74160205-c304-4e42-b2e6-458e2ecc00d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22401f2-3ab8-47c5-a835-8e23c763cbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22401f2-3ab8-47c5-a835-8e23c763cbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a780032e-f576-477c-a0ad-859b8615923a', 'volume_name': 'volume-a780032e-f576-477c-a0ad-859b8615923a', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38304774-3b12-4cb6-aec3-8fac59879ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38304774-3b12-4cb6-aec3-8fac59879ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ba2e37-25ec-4974-8615-93d26badb606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:32 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Volume a780032e-f576-477c-a0ad-859b8615923a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a780032e-f576-477c-a0ad-859b8615923a', 'volume_size': 1} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1696183922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a780032e-f576-477c-a0ad-859b8615923a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0eae96c8294a7393201626f08b1c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:32Z,use_quota=True,user_id='d4a2994ae89d4135af51a131f5a320d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Creating volume a780032e-f576-477c-a0ad-859b8615923a {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:25:32 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:25:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:32 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a 1073741824 Sep 11 21:25:32 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:33 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Acquiring lock "cinder-92aaf0d0-2caf-4378-bcb4-41241a5c284c-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:25:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a 1073741824" returned: 0 in 0.772s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Lock "cinder-92aaf0d0-2caf-4378-bcb4-41241a5c284c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:25:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:33 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a Sep 11 21:25:33 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Acquiring lock "cinder-quobyte-92aaf0d0-2caf-4378-bcb4-41241a5c284c" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:25:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Lock "cinder-quobyte-92aaf0d0-2caf-4378-bcb4-41241a5c284c" acquired by "delete_volume" :: waited 0.040s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:25:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4137fd-0319-42db-b992-295eed9bb674]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:25:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:33 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c Sep 11 21:25:33 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:34 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a" returned: 0 in 0.474s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ba2e37-25ec-4974-8615-93d26badb606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a780032e-f576-477c-a0ad-859b8615923a', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbbab04-6e19-4076-b556-5a7f8c513cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:34 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Volume volume-a780032e-f576-477c-a0ad-859b8615923a (a780032e-f576-477c-a0ad-859b8615923a): created successfully Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbbab04-6e19-4076-b556-5a7f8c513cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Flow 'volume_create_manager' (398c825f-5ca8-4ec0-acdc-acb0d45560f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3954d961-5546-4456-96e0-20eefacfeff8 tempest-ServerActionsTestOtherA-316171242 None] Created volume successfully. Sep 11 21:25:34 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c" returned: 0 in 0.722s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:34 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c Sep 11 21:25:34 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:34 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-92aaf0d0-2caf-4378-bcb4-41241a5c284c" returned: 0 in 0.363s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Lock "cinder-quobyte-92aaf0d0-2caf-4378-bcb4-41241a5c284c" released by "delete_volume" :: held 1.167s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Created reservations ['c9a1bb43-64a8-47cd-8fa4-73f4050edc80', 'f83309c3-6c33-4631-bc4e-9b71c542f51d', 'c4c7ab43-def9-4834-828a-53439f22b692', '103a0e3d-2655-479a-9084-9fcba0dea4f7'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:35 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:25:35 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:35 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.328s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:35 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:25:35 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Deleted volume successfully. Sep 11 21:25:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6867035a-d3eb-4516-aa18-311eff21fc8f tempest-VolumesServicesTestJSON-1446362563 None] Lock "cinder-92aaf0d0-2caf-4378-bcb4-41241a5c284c-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:25:44 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=48,cinder:SELECT=35,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:25:45 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=43,cinder:UPDATE=56,cinder:DELETE=4,cinder:INSERT=10 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:25:47 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-d836f5dd-82e9-45e4-bcb1-f886e33f4c84 req-b444cf1e-6cb8-4c16-9441-c1c895721bba tempest-AttachVolumeTestJSON-680445976 None] Terminate volume connection completed successfully. Sep 11 21:25:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-d836f5dd-82e9-45e4-bcb1-f886e33f4c84 req-b444cf1e-6cb8-4c16-9441-c1c895721bba tempest-AttachVolumeTestJSON-680445976 None] Deleting attachment 5b545b8c-dd74-4e27-aa4d-d8d485b2ed9b. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:25:57 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=1 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:25:57 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=1 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Flow 'volume_create_manager' (b1ede99b-ae20-4eb4-918c-16ac19e82db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a9e8c2-f191-4bb0-be60-91520f466418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a9e8c2-f191-4bb0-be60-91520f466418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1632663751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b95238-858b-420b-98a5-d32a9b87becf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d77f9156634c74bb0a91d8e3526fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:59Z,use_quota=True,user_id='353f401410494d3db473772a16247079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5768df6-87f5-43a0-893b-54434d412879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5768df6-87f5-43a0-893b-54434d412879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846642f5-7e31-4ab0-93de-c3f0d466c1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846642f5-7e31-4ab0-93de-c3f0d466c1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b95238-858b-420b-98a5-d32a9b87becf', 'volume_name': 'volume-19b95238-858b-420b-98a5-d32a9b87becf', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8577bf13-14b0-4f9a-9ac8-fc3bbf493c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8577bf13-14b0-4f9a-9ac8-fc3bbf493c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53fe5f1-9915-49fb-95cc-de41dbec8b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Volume 19b95238-858b-420b-98a5-d32a9b87becf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b95238-858b-420b-98a5-d32a9b87becf', 'volume_size': 1} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1632663751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b95238-858b-420b-98a5-d32a9b87becf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d77f9156634c74bb0a91d8e3526fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:25:59Z,use_quota=True,user_id='353f401410494d3db473772a16247079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Creating volume 19b95238-858b-420b-98a5-d32a9b87becf {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:25:59 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:59 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf 1073741824 Sep 11 21:25:59 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:59 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf 1073741824" returned: 0 in 0.456s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:25:59 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf Sep 11 21:25:59 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:25:59 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf" returned: 0 in 0.278s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53fe5f1-9915-49fb-95cc-de41dbec8b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b95238-858b-420b-98a5-d32a9b87becf', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc441d5a-249e-4c0d-80da-221f929fc7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:25:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Volume volume-19b95238-858b-420b-98a5-d32a9b87becf (19b95238-858b-420b-98a5-d32a9b87becf): created successfully Sep 11 21:25:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc441d5a-249e-4c0d-80da-221f929fc7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Flow 'volume_create_manager' (b1ede99b-ae20-4eb4-918c-16ac19e82db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:00 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-54f6c718-044f-46c5-9658-6d4e0e06ca36 tempest-VolumesListAdminTestJSON-1239117365 None] Created volume successfully. Sep 11 21:26:01 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:26:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Flow 'volume_create_manager' (6345d44b-aac7-4441-a134-b2fbe0b93102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902c98e3-beb4-4c01-840e-abffaaa9f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902c98e3-beb4-4c01-840e-abffaaa9f82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1309323556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162a08bb-9eea-4b08-9965-e1865fa8fdb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d77f9156634c74bb0a91d8e3526fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:02Z,use_quota=True,user_id='353f401410494d3db473772a16247079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e49368-76f6-4159-acd9-77e6b4330042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e49368-76f6-4159-acd9-77e6b4330042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5a736f-2850-4f71-9f46-aca89de0b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5a736f-2850-4f71-9f46-aca89de0b99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162a08bb-9eea-4b08-9965-e1865fa8fdb7', 'volume_name': 'volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843f528d-574a-4c17-baf1-8a2cbc88d787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843f528d-574a-4c17-baf1-8a2cbc88d787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cb9c60-0ef4-4867-813c-9e55822ae09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:02 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Volume 162a08bb-9eea-4b08-9965-e1865fa8fdb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7', 'volume_size': 1} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1309323556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162a08bb-9eea-4b08-9965-e1865fa8fdb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d77f9156634c74bb0a91d8e3526fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:02Z,use_quota=True,user_id='353f401410494d3db473772a16247079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Creating volume 162a08bb-9eea-4b08-9965-e1865fa8fdb7 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:26:02 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:02 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 1073741824 Sep 11 21:26:02 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:02 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 1073741824" returned: 0 in 0.547s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:02 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 Sep 11 21:26:02 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:02 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7" returned: 0 in 0.313s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cb9c60-0ef4-4867-813c-9e55822ae09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7241df54-1d0e-468d-99ba-1f76a3b75fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:02 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Volume volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 (162a08bb-9eea-4b08-9965-e1865fa8fdb7): created successfully Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7241df54-1d0e-468d-99ba-1f76a3b75fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Flow 'volume_create_manager' (6345d44b-aac7-4441-a134-b2fbe0b93102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6d93f6aa-270a-4dcf-950d-342762e738b8 tempest-VolumesListAdminTestJSON-1239117365 None] Created volume successfully. Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Flow 'volume_create_manager' (be922987-f6d3-4083-b8b3-8dc82e52fe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa51eda9-17c6-4da6-92e7-4e58d2117874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa51eda9-17c6-4da6-92e7-4e58d2117874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-375191710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ad3aac-2e90-4295-95fa-309d07c1c5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d77f9156634c74bb0a91d8e3526fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:05Z,use_quota=True,user_id='353f401410494d3db473772a16247079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78e0c43-52ce-4894-bb27-e2033afba6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78e0c43-52ce-4894-bb27-e2033afba6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a940279f-a574-48d5-b23c-a2cb1549afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a940279f-a574-48d5-b23c-a2cb1549afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ad3aac-2e90-4295-95fa-309d07c1c5b1', 'volume_name': 'volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08563d4d-12f4-44cd-aa94-c9668e1545d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08563d4d-12f4-44cd-aa94-c9668e1545d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbb6e68-a9ec-4cec-abf9-11a0845845d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Volume 10ad3aac-2e90-4295-95fa-309d07c1c5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1', 'volume_size': 1} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-375191710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ad3aac-2e90-4295-95fa-309d07c1c5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d77f9156634c74bb0a91d8e3526fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:05Z,use_quota=True,user_id='353f401410494d3db473772a16247079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Creating volume 10ad3aac-2e90-4295-95fa-309d07c1c5b1 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:26:04 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:26:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:04 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 1073741824 Sep 11 21:26:04 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:05 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 1073741824" returned: 0 in 0.437s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:05 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 Sep 11 21:26:05 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:05 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1" returned: 0 in 0.243s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:26:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbb6e68-a9ec-4cec-abf9-11a0845845d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93396465-03a3-4a05-b97a-730495e86e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:05 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Volume volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 (10ad3aac-2e90-4295-95fa-309d07c1c5b1): created successfully Sep 11 21:26:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93396465-03a3-4a05-b97a-730495e86e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Flow 'volume_create_manager' (be922987-f6d3-4083-b8b3-8dc82e52fe98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e3f81f7e-a322-47a7-b08c-c6da649bbf7c tempest-VolumesListAdminTestJSON-1239117365 None] Created volume successfully. Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Flow 'volume_create_manager' (81a5b4ad-9074-468e-b7ad-b139b69f9c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbc3faf-384c-4481-b53f-625093284037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbc3faf-384c-4481-b53f-625093284037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d9ce62-57c7-4bfb-9845-318aac830f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8234f83c9d7488888c58918d98287b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:07Z,use_quota=True,user_id='5967cfd0d3454e9095b099cf5c1f4777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb00877c-c31f-4f2b-a090-bf0b6c001d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb00877c-c31f-4f2b-a090-bf0b6c001d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746f740e-9283-4c3d-af24-1bddccd2a8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746f740e-9283-4c3d-af24-1bddccd2a8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d9ce62-57c7-4bfb-9845-318aac830f3f', 'volume_name': 'volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97975114-ec9a-4874-b639-0e06af58aaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97975114-ec9a-4874-b639-0e06af58aaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a527f346-0f5b-4b02-9e15-56c0a20a0795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Volume c0d9ce62-57c7-4bfb-9845-318aac830f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f', 'volume_size': 1} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d9ce62-57c7-4bfb-9845-318aac830f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8234f83c9d7488888c58918d98287b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:07Z,use_quota=True,user_id='5967cfd0d3454e9095b099cf5c1f4777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Creating volume c0d9ce62-57c7-4bfb-9845-318aac830f3f {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:26:07 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:26:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:07 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f 1073741824 Sep 11 21:26:07 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:08 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f 1073741824" returned: 0 in 0.489s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:08 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f Sep 11 21:26:08 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:08 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f" returned: 0 in 0.271s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:26:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a527f346-0f5b-4b02-9e15-56c0a20a0795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b08550-087d-4cff-9241-735e2562bcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:08 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Volume volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f (c0d9ce62-57c7-4bfb-9845-318aac830f3f): created successfully Sep 11 21:26:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b08550-087d-4cff-9241-735e2562bcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Flow 'volume_create_manager' (81a5b4ad-9074-468e-b7ad-b139b69f9c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:08 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-41f0a810-0684-4b00-bd4e-53d905473e31 tempest-VolumesListAdminTestJSON-507598605 None] Created volume successfully. Sep 11 21:26:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Acquiring lock "cinder-c0d9ce62-57c7-4bfb-9845-318aac830f3f-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Lock "cinder-c0d9ce62-57c7-4bfb-9845-318aac830f3f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Acquiring lock "cinder-quobyte-c0d9ce62-57c7-4bfb-9845-318aac830f3f" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Lock "cinder-quobyte-c0d9ce62-57c7-4bfb-9845-318aac830f3f" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb9fb94-b60a-4fd8-8ca1-ae3f58866cf1]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:10 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f Sep 11 21:26:10 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "cinder-10ad3aac-2e90-4295-95fa-309d07c1c5b1-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-10ad3aac-2e90-4295-95fa-309d07c1c5b1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "cinder-quobyte-10ad3aac-2e90-4295-95fa-309d07c1c5b1" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-quobyte-10ad3aac-2e90-4295-95fa-309d07c1c5b1" acquired by "delete_volume" :: waited 0.042s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdd654a-fd16-475e-89f5-6fe1108a53e3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:10 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f" returned: 0 in 0.611s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:10 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 Sep 11 21:26:10 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:10 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f Sep 11 21:26:10 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:11 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1" returned: 0 in 0.635s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:11 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1 Sep 11 21:26:11 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:11 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c0d9ce62-57c7-4bfb-9845-318aac830f3f" returned: 0 in 0.686s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Lock "cinder-quobyte-c0d9ce62-57c7-4bfb-9845-318aac830f3f" released by "delete_volume" :: held 1.405s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Created reservations ['b78dd698-071e-4147-8730-598c0c77e756', '096f225c-f34b-4994-974b-c2cbef124b65', '9aff300f-48d8-4a65-b003-98345e23ee01', '92e1133c-e4e9-4069-a215-49efb7f404ac'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:26:11 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10ad3aac-2e90-4295-95fa-309d07c1c5b1" returned: 0 in 0.571s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-quobyte-10ad3aac-2e90-4295-95fa-309d07c1c5b1" released by "delete_volume" :: held 1.327s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:11 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:26:11 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-0eff95d2-8057-46d4-a283-17a1c7904a1a req-20cf9d32-fd74-4e6d-9c92-1e7989494af6 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-0eff95d2-8057-46d4-a283-17a1c7904a1a req-20cf9d32-fd74-4e6d-9c92-1e7989494af6 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-0eff95d2-8057-46d4-a283-17a1c7904a1a req-20cf9d32-fd74-4e6d-9c92-1e7989494af6 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:11 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Created reservations ['f1c31ce4-0441-4e97-838e-6eff0d8f6711', 'c2851127-0f67-443d-972f-f6f2384f8eee', 'e4fa6d8e-783f-4b8e-9ae8-da8e653f1da5', '33dd584d-f42e-4fc0-bfb5-c23e2c0c3521'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-0eff95d2-8057-46d4-a283-17a1c7904a1a req-20cf9d32-fd74-4e6d-9c92-1e7989494af6 tempest-ServerActionsTestOtherA-316171242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-a780032e-f576-477c-a0ad-859b8615923a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62ad02a5-6eb5-434c-a871-1e7188b6082f', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:26:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-0eff95d2-8057-46d4-a283-17a1c7904a1a req-20cf9d32-fd74-4e6d-9c92-1e7989494af6 tempest-ServerActionsTestOtherA-316171242 None] attachment_update completed successfully. Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:12 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:26:12 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:12 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.516s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:26:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Deleted volume successfully. Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e0855637-0ef5-4bc9-8c45-9c9baf15b80e tempest-VolumesListAdminTestJSON-507598605 None] Lock "cinder-c0d9ce62-57c7-4bfb-9845-318aac830f3f-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:12 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.423s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:26:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Deleted volume successfully. Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-00f2d17e-6630-4008-9367-27de16f49ef9 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-10ad3aac-2e90-4295-95fa-309d07c1c5b1-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "cinder-162a08bb-9eea-4b08-9965-e1865fa8fdb7-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-162a08bb-9eea-4b08-9965-e1865fa8fdb7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "cinder-quobyte-162a08bb-9eea-4b08-9965-e1865fa8fdb7" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-quobyte-162a08bb-9eea-4b08-9965-e1865fa8fdb7" acquired by "delete_volume" :: waited 0.039s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[896da400-708c-4e27-b296-25122840c2cc]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:13 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 Sep 11 21:26:13 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:13 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7" returned: 0 in 0.418s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:13 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7 Sep 11 21:26:13 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:13 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-162a08bb-9eea-4b08-9965-e1865fa8fdb7" returned: 0 in 0.252s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-quobyte-162a08bb-9eea-4b08-9965-e1865fa8fdb7" released by "delete_volume" :: held 0.724s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Created reservations ['3602d2d7-1237-4d49-afae-b88ecb0ee2b2', 'b6440285-ff72-4b50-8e6d-115c5bb08567', '4a8b06f5-61d0-417b-8940-4b32aa66582d', '2ebd84aa-7cb5-420a-97dc-2e11d50c77cc'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:13 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:26:13 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "cinder-19b95238-858b-420b-98a5-d32a9b87becf-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:14 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.282s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-19b95238-858b-420b-98a5-d32a9b87becf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:14 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Deleted volume successfully. Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3f8574da-dab4-473c-ab96-1caa3526aa80 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-162a08bb-9eea-4b08-9965-e1865fa8fdb7-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "cinder-quobyte-19b95238-858b-420b-98a5-d32a9b87becf" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-quobyte-19b95238-858b-420b-98a5-d32a9b87becf" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e3cac8-94dd-42f1-aa96-b0d8338c9ed3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:14 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf Sep 11 21:26:14 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:14 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf" returned: 0 in 0.448s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:14 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf Sep 11 21:26:14 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:15 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19b95238-858b-420b-98a5-d32a9b87becf" returned: 0 in 0.306s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-quobyte-19b95238-858b-420b-98a5-d32a9b87becf" released by "delete_volume" :: held 0.792s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Created reservations ['a71c770d-65c8-41f8-abf2-d059dc730a79', 'fab2ebc7-e6a7-4652-85c6-4ba65903cdf0', '68b4368a-8a33-4b69-b274-687563234695', 'caff3947-dda4-42fe-ba6b-456bd9470e21'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:15 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:26:15 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:15 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.247s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:26:15 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Deleted volume successfully. Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6df8433a-f43e-4976-a49c-d60f54a46993 tempest-VolumesListAdminTestJSON-1239117365 None] Lock "cinder-19b95238-858b-420b-98a5-d32a9b87becf-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:15 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-e954ef82-6254-4315-920e-decdd6c4bac0 req-7946dd23-27ac-48dc-92cc-27489e98bc8c tempest-ServerActionsTestOtherA-316171242 None] Terminate volume connection completed successfully. Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-e954ef82-6254-4315-920e-decdd6c4bac0 req-7946dd23-27ac-48dc-92cc-27489e98bc8c tempest-ServerActionsTestOtherA-316171242 None] Deleting attachment 62ad02a5-6eb5-434c-a871-1e7188b6082f. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:15 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:26:15 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:16 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.397s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:26:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-e954ef82-6254-4315-920e-decdd6c4bac0 req-f2611b87-f647-42cd-8ef6-d096cae0e1a9 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-e954ef82-6254-4315-920e-decdd6c4bac0 req-f2611b87-f647-42cd-8ef6-d096cae0e1a9 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-e954ef82-6254-4315-920e-decdd6c4bac0 req-f2611b87-f647-42cd-8ef6-d096cae0e1a9 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-e954ef82-6254-4315-920e-decdd6c4bac0 req-f2611b87-f647-42cd-8ef6-d096cae0e1a9 tempest-ServerActionsTestOtherA-316171242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-a780032e-f576-477c-a0ad-859b8615923a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd77cdef4-c0ca-4aa9-b321-aa0eff8602ce', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:26:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-e954ef82-6254-4315-920e-decdd6c4bac0 req-f2611b87-f647-42cd-8ef6-d096cae0e1a9 tempest-ServerActionsTestOtherA-316171242 None] attachment_update completed successfully. Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Flow 'volume_create_manager' (2b1374fc-e56e-4091-a138-6330a7ce6b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b52be3c-a1f0-4bbc-a2a8-17b173a45680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b52be3c-a1f0-4bbc-a2a8-17b173a45680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1168254774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ecb33d-534b-4ef2-a9fa-c9205b02220a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5965a4a51f04af4b74bbc48c359fb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:22Z,use_quota=True,user_id='2dfed7807ca84b54a686139c39ef116d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f606a544-dcbb-4bf9-ada8-221694a072c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f606a544-dcbb-4bf9-ada8-221694a072c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5487eff6-5f19-4312-a3c8-cd8129d707a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5487eff6-5f19-4312-a3c8-cd8129d707a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ecb33d-534b-4ef2-a9fa-c9205b02220a', 'volume_name': 'volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099689db-79e2-477d-a988-ac4181978635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099689db-79e2-477d-a988-ac4181978635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e991295-8c22-4b3a-8d36-67886120ff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:22 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Volume 83ecb33d-534b-4ef2-a9fa-c9205b02220a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a', 'volume_size': 1} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1168254774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ecb33d-534b-4ef2-a9fa-c9205b02220a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5965a4a51f04af4b74bbc48c359fb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:22Z,use_quota=True,user_id='2dfed7807ca84b54a686139c39ef116d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Creating volume 83ecb33d-534b-4ef2-a9fa-c9205b02220a {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:26:22 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:22 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a 1073741824 Sep 11 21:26:22 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:22 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a 1073741824" returned: 0 in 0.507s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:22 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a Sep 11 21:26:22 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:23 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a" returned: 0 in 0.313s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:26:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e991295-8c22-4b3a-8d36-67886120ff74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8524ec50-2469-4ef6-afc0-4e78ac872a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:23 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Volume volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a (83ecb33d-534b-4ef2-a9fa-c9205b02220a): created successfully Sep 11 21:26:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8524ec50-2469-4ef6-afc0-4e78ac872a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Flow 'volume_create_manager' (2b1374fc-e56e-4091-a138-6330a7ce6b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:23 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9b1dbb84-99a2-465c-94c6-081afb52ec14 tempest-AttachVolumeShelveTestJSON-707886685 None] Created volume successfully. Sep 11 21:26:26 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:26:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Flow 'volume_create_manager' (96db6057-3c16-4309-9f47-101a5fbf92d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015ac638-8269-4f02-9fad-27632387e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015ac638-8269-4f02-9fad-27632387e8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-292629069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180e4e25-daed-46f2-acae-657933fafd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a91add11a9414d8768fb448b0f4e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:27Z,use_quota=True,user_id='1fea6093dea84193844a6eba4e5cdaf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5d6ac1-9497-45df-beab-fc1991216c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5d6ac1-9497-45df-beab-fc1991216c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d3cf06-5ba1-462b-9bf8-0157bf6d76f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:26 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:26:27 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d3cf06-5ba1-462b-9bf8-0157bf6d76f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '180e4e25-daed-46f2-acae-657933fafd8d', 'volume_name': 'volume-180e4e25-daed-46f2-acae-657933fafd8d', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:27 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8282136b-663e-48aa-be01-9138a9518e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:27 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8282136b-663e-48aa-be01-9138a9518e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:27 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f21b8cf-be85-4ff2-8355-4106afadb49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:27 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Volume 180e4e25-daed-46f2-acae-657933fafd8d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-180e4e25-daed-46f2-acae-657933fafd8d', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 21:26:27 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Trying to clone 180e4e25-daed-46f2-acae-657933fafd8d from image 8333088b-528a-4438-98ec-37d49b129d98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:26:27 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:26:27 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Image download 20.69 MB at 20.69 MB/s Sep 11 21:26:27 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e727ff4-1321-4a0c-baa6-9aeb8050cee0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:27 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD Sep 11 21:26:27 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:28 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 is fetched for user 1fea6093dea84193844a6eba4e5cdaf7. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a42e140-76b3-4d8d-8d66-793513c9eb76]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:28 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD Sep 11 21:26:28 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:28 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-292629069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180e4e25-daed-46f2-acae-657933fafd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a91add11a9414d8768fb448b0f4e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:27Z,use_quota=True,user_id='1fea6093dea84193844a6eba4e5cdaf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Creating volume 180e4e25-daed-46f2-acae-657933fafd8d {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:26:28 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:26:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:28 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d 1073741824 Sep 11 21:26:28 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:29 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d 1073741824" returned: 0 in 0.461s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:29 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d Sep 11 21:26:29 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:29 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d" returned: 0 in 0.287s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:26:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:29 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Attempting download of 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume 180e4e25-daed-46f2-acae-657933fafd8d. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:26:29 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c07de65-9255-447d-b25b-787694594d46]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_e8ifjapb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:29 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_e8ifjapb Sep 11 21:26:29 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:30 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_e8ifjapb" returned: 0 in 0.436s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_e8ifjapb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:30 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_e8ifjapb Sep 11 21:26:30 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:30 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_e8ifjapb" returned: 1 in 0.409s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_e8ifjapb' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:26:30 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[9486257c-2f6e-4b36-a77d-be25594f4ffb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:30 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD Sep 11 21:26:30 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:30 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:30 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] 8333088b-528a-4438-98ec-37d49b129d98 was qcow2, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:26:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:30 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d Sep 11 21:26:30 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:33 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d" returned: 0 in 2.180s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_c29k298edevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:26:33 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Converted 112.00 MB image at 51.34 MB/s Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:33 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d 1G Sep 11 21:26:33 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:33 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d 1G" returned: 0 in 0.345s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Downloaded image 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume 180e4e25-daed-46f2-acae-657933fafd8d successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 for user 1fea6093dea84193844a6eba4e5cdaf7 is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Marking volume 180e4e25-daed-46f2-acae-657933fafd8d as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Copying metadata from image 8333088b-528a-4438-98ec-37d49b129d98 to 180e4e25-daed-46f2-acae-657933fafd8d. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Creating volume glance metadata for volume 180e4e25-daed-46f2-acae-657933fafd8d backed by image 8333088b-528a-4438-98ec-37d49b129d98 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f21b8cf-be85-4ff2-8355-4106afadb49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180e4e25-daed-46f2-acae-657933fafd8d', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddda68c9-858e-488b-adbf-fe7e865298f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:33 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Volume volume-180e4e25-daed-46f2-acae-657933fafd8d (180e4e25-daed-46f2-acae-657933fafd8d): created successfully Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddda68c9-858e-488b-adbf-fe7e865298f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Flow 'volume_create_manager' (96db6057-3c16-4309-9f47-101a5fbf92d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:33 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-857eb316-96c5-40ef-be0b-2b7e52911e47 tempest-VolumesImageMetadata-1877551976 None] Created volume successfully. Sep 11 21:26:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-dd8f5a25-4456-4cc4-bb7c-e921139f08aa req-aa149031-4dc2-4e24-b0fd-a74caa1d1799 tempest-AttachVolumeShelveTestJSON-707886685 None] No connector for attachment 6d02d71e-66b7-4d6a-be1e-a40316e39713; skipping storage backend terminate_connection call. {{(pid=87423) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 11 21:26:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-dd8f5a25-4456-4cc4-bb7c-e921139f08aa req-aa149031-4dc2-4e24-b0fd-a74caa1d1799 tempest-AttachVolumeShelveTestJSON-707886685 None] Deleting attachment 6d02d71e-66b7-4d6a-be1e-a40316e39713. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:26:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Acquiring lock "cinder-180e4e25-daed-46f2-acae-657933fafd8d-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Lock "cinder-180e4e25-daed-46f2-acae-657933fafd8d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Acquiring lock "cinder-quobyte-180e4e25-daed-46f2-acae-657933fafd8d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Lock "cinder-quobyte-180e4e25-daed-46f2-acae-657933fafd8d" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:34 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c897c5-f3d5-4545-8fc2-bb6b15db15dd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:35 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d Sep 11 21:26:35 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:35 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d" returned: 0 in 0.435s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:35 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d Sep 11 21:26:35 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:35 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-180e4e25-daed-46f2-acae-657933fafd8d" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Lock "cinder-quobyte-180e4e25-daed-46f2-acae-657933fafd8d" released by "delete_volume" :: held 0.880s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:35 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Created reservations ['2a8b76de-6716-4939-804c-f0dbaa7f7846', 'f64ffbc2-4143-4d0c-903f-12de15963ae1', '76a060ba-3f4c-4763-8385-0ef9147f0596', '7a9d6b65-7e5b-45ec-9b79-9b884ab4f4ba'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:26:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:36 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:36 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:36 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:26:36 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:36 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.360s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:36 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:26:36 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Deleted volume successfully. Sep 11 21:26:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0a346467-c8c0-4afd-9996-585ddcdf7d2c tempest-VolumesImageMetadata-1877551976 None] Lock "cinder-180e4e25-daed-46f2-acae-657933fafd8d-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Flow 'volume_create_manager' (9fb1b0d0-16ab-4b38-96f6-5bdabc335953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994d6edf-81a3-47c9-83f8-bcdefec51ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994d6edf-81a3-47c9-83f8-bcdefec51ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1366090277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c1f071-3d1b-482b-b600-6aec83d708bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7a06a8724d4d4d9d14cdaedb23f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:43Z,use_quota=True,user_id='2f0c9560954643e489e54134864d919d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9cb34f-f49a-45f7-9baa-65fc10337200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9cb34f-f49a-45f7-9baa-65fc10337200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f51379-f3f0-4b4e-a319-067388ea9745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f51379-f3f0-4b4e-a319-067388ea9745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c1f071-3d1b-482b-b600-6aec83d708bc', 'volume_name': 'volume-a3c1f071-3d1b-482b-b600-6aec83d708bc', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ca1003-d48e-4b17-8f8f-2e7ace0f583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ca1003-d48e-4b17-8f8f-2e7ace0f583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adc5baa-a196-43ff-8f50-8bcd34d88ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:43 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Volume a3c1f071-3d1b-482b-b600-6aec83d708bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c1f071-3d1b-482b-b600-6aec83d708bc', 'volume_size': 1} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1366090277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c1f071-3d1b-482b-b600-6aec83d708bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7a06a8724d4d4d9d14cdaedb23f43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:43Z,use_quota=True,user_id='2f0c9560954643e489e54134864d919d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Creating volume a3c1f071-3d1b-482b-b600-6aec83d708bc {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:26:43 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:26:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:43 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc 1073741824 Sep 11 21:26:43 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:44 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc 1073741824" returned: 0 in 0.496s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:44 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc Sep 11 21:26:44 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:44 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc" returned: 0 in 0.381s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:26:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adc5baa-a196-43ff-8f50-8bcd34d88ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c1f071-3d1b-482b-b600-6aec83d708bc', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83982624-346f-4047-94ff-d1dec7cfd097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:44 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Volume volume-a3c1f071-3d1b-482b-b600-6aec83d708bc (a3c1f071-3d1b-482b-b600-6aec83d708bc): created successfully Sep 11 21:26:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83982624-346f-4047-94ff-d1dec7cfd097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Flow 'volume_create_manager' (9fb1b0d0-16ab-4b38-96f6-5bdabc335953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2a5191c2-440f-4acb-88fd-7569c8e6b30d tempest-AbsoluteLimitsTests-1753731121 None] Created volume successfully. Sep 11 21:26:45 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-6e605f89-bd51-413e-97fb-bcf11d13b631 req-44e302d0-7571-4105-b5f9-f6756d3a0837 tempest-ServerActionsTestOtherA-316171242 None] Terminate volume connection completed successfully. Sep 11 21:26:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-6e605f89-bd51-413e-97fb-bcf11d13b631 req-44e302d0-7571-4105-b5f9-f6756d3a0837 tempest-ServerActionsTestOtherA-316171242 None] Deleting attachment d77cdef4-c0ca-4aa9-b321-aa0eff8602ce. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:26:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Acquiring lock "cinder-a3c1f071-3d1b-482b-b600-6aec83d708bc-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Lock "cinder-a3c1f071-3d1b-482b-b600-6aec83d708bc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Acquiring lock "cinder-quobyte-a3c1f071-3d1b-482b-b600-6aec83d708bc" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:26:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Lock "cinder-quobyte-a3c1f071-3d1b-482b-b600-6aec83d708bc" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:26:46 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb043f5-8ca7-4c12-8d1d-dd4a5ed0d014]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:46 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc Sep 11 21:26:46 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:46 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc" returned: 0 in 0.736s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:46 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc Sep 11 21:26:46 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:47 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a3c1f071-3d1b-482b-b600-6aec83d708bc" returned: 0 in 0.661s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Lock "cinder-quobyte-a3c1f071-3d1b-482b-b600-6aec83d708bc" released by "delete_volume" :: held 1.459s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:47 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Created reservations ['d4f5b594-495d-4269-b2b5-1be8d08e997e', 'af457770-bcd6-4d39-b98c-43ab7bf5aff1', 'dad5a1b0-9389-4418-a810-eb5856d98084', '13f3604a-d47b-473c-81e6-d507dd1785ac'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:26:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:26:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:26:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:26:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:26:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:26:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:26:47 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:26:47 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:26:48 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 11 21:26:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.797s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:26:48 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:26:48 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Deleted volume successfully. Sep 11 21:26:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d842a8e1-43ac-4163-9583-ab3e9599ad03 tempest-AbsoluteLimitsTests-1753731121 None] Lock "cinder-a3c1f071-3d1b-482b-b600-6aec83d708bc-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:26:57 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=72,cinder:UPDATE=86,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=62,cinder:SELECT=63,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Flow 'volume_create_manager' (3451acaa-4493-44d0-9650-1dcccd314777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc5e27b-b747-4ec2-9716-569e9860ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc5e27b-b747-4ec2-9716-569e9860ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-281949544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb90658-ed09-4409-ba8c-f109a78adeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0eae96c8294a7393201626f08b1c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:58Z,use_quota=True,user_id='d4a2994ae89d4135af51a131f5a320d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2584bf01-3754-49e4-a264-4948c7962871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2584bf01-3754-49e4-a264-4948c7962871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d83ffe4-f309-4c3f-8c8e-a43b07ff8142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d83ffe4-f309-4c3f-8c8e-a43b07ff8142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3bb90658-ed09-4409-ba8c-f109a78adeec', 'volume_name': 'volume-3bb90658-ed09-4409-ba8c-f109a78adeec', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb54c2be-2a7f-416a-a803-197ccba68fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb54c2be-2a7f-416a-a803-197ccba68fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7058b1ec-8048-4abc-8a1d-d8d6236fe1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:26:58 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Volume 3bb90658-ed09-4409-ba8c-f109a78adeec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3bb90658-ed09-4409-ba8c-f109a78adeec', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 21:26:58 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Trying to clone 3bb90658-ed09-4409-ba8c-f109a78adeec from image 8333088b-528a-4438-98ec-37d49b129d98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:26:59 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:26:59 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Image download 20.69 MB at 20.69 MB/s Sep 11 21:26:59 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32fa2d6-a1bd-4306-8724-3349a96a5e21]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:26:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:00 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD Sep 11 21:27:00 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:00 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 is fetched for user d4a2994ae89d4135af51a131f5a320d4. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Flow 'volume_create_manager' (e4e5efed-1e3b-4d77-bcd3-c7dd0d786931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d77513-601b-4968-95a8-fe0c28282ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[24be211e-9471-444f-a1c6-ca96b0b3bd49]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d77513-601b-4968-95a8-fe0c28282ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1500758201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093dc52c12e6448d81ffb7887c92601a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:01Z,use_quota=True,user_id='acc33e2b4f7845189d52bb590338e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd00dd2-e79d-4365-b659-b614e6110424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd00dd2-e79d-4365-b659-b614e6110424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d65001-5deb-4ab5-83f9-1188dcda5c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d65001-5deb-4ab5-83f9-1188dcda5c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592', 'volume_name': 'volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6efc2fc-9cd3-4163-9c8f-c59fc3a57a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6efc2fc-9cd3-4163-9c8f-c59fc3a57a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e289887-52c6-48be-9dad-8516c4e431af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:00 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Volume cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592', 'volume_size': 1} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1500758201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093dc52c12e6448d81ffb7887c92601a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:01Z,use_quota=True,user_id='acc33e2b4f7845189d52bb590338e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Creating volume cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:27:00 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:27:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:00 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 1073741824 Sep 11 21:27:00 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:00 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD Sep 11 21:27:00 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:01 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:01 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 1073741824" returned: 0 in 0.730s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:01 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 Sep 11 21:27:01 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:01 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592" returned: 0 in 0.259s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-281949544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb90658-ed09-4409-ba8c-f109a78adeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0eae96c8294a7393201626f08b1c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:26:58Z,use_quota=True,user_id='d4a2994ae89d4135af51a131f5a320d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Creating volume 3bb90658-ed09-4409-ba8c-f109a78adeec {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:27:01 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e289887-52c6-48be-9dad-8516c4e431af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:01 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec 1073741824 Sep 11 21:27:01 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2812321-d85b-4366-b07e-44438c223943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:02 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Volume volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 (cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592): created successfully Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2812321-d85b-4366-b07e-44438c223943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Flow 'volume_create_manager' (e4e5efed-1e3b-4d77-bcd3-c7dd0d786931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:02 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-012fafba-0392-4a6d-8a10-99bc6c2b5a3e tempest-VolumesTransfersTest-378589268 None] Created volume successfully. Sep 11 21:27:02 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec 1073741824" returned: 0 in 0.502s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:02 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec Sep 11 21:27:02 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:02 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec" returned: 0 in 0.304s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Attempting download of 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume 3bb90658-ed09-4409-ba8c-f109a78adeec. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0d3f06-4c31-473d-a5a9-8326dca58f4b]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_cdz1vk1n {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:03 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_cdz1vk1n Sep 11 21:27:03 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:03 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_cdz1vk1n" returned: 0 in 0.376s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_cdz1vk1n {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:03 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_cdz1vk1n Sep 11 21:27:03 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8f655b40-d368-49c8-bc73-cda516611a13 tempest-VolumesTransfersTest-678459564 None] Transfer volume completed successfully. Sep 11 21:27:03 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_cdz1vk1n" returned: 1 in 0.364s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_cdz1vk1n' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:27:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac83d24-7f4a-457a-8e67-18b47e33f373]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:03 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD Sep 11 21:27:03 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:04 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] 8333088b-528a-4438-98ec-37d49b129d98 was qcow2, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:04 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec Sep 11 21:27:04 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Acquiring lock "cinder-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Lock "cinder-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Acquiring lock "cinder-quobyte-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Lock "cinder-quobyte-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b143fe06-0649-448d-8150-3d5269e3e40f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:04 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 Sep 11 21:27:04 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:04 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592" returned: 0 in 0.365s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:04 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592 Sep 11 21:27:04 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:04 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592" returned: 0 in 0.263s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Lock "cinder-quobyte-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592" released by "delete_volume" :: held 0.684s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Created reservations ['4de8317a-19a7-4f5a-8290-31d32b17690b', '200e6e2b-2e05-498e-80dc-955d096f45d5', '55411f91-1800-47d7-8f0b-12bf9aa5614d', 'a74ce71e-793b-4339-ade0-24e2782f831f'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:05 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:27:05 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:05 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.294s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:27:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Deleted volume successfully. Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb6a0c81-5119-495f-9bc4-11603ce40557 tempest-VolumesTransfersTest-1531512015 None] Lock "cinder-cdec0f55-bd9f-4eeb-adcb-a5ae9a3da592-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:05 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec" returned: 0 in 1.898s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_s4t20eoxdevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:27:05 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Converted 112.00 MB image at 58.97 MB/s Sep 11 21:27:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:05 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec 1G Sep 11 21:27:05 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Flow 'volume_create_manager' (35fb7f4d-a783-4597-be2b-ac7f6d3e5460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0a508f-1008-4750-86dc-2819e1091bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0a508f-1008-4750-86dc-2819e1091bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1608988829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad193683-f3d5-4fc3-945e-677a47b53944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093dc52c12e6448d81ffb7887c92601a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:06Z,use_quota=True,user_id='acc33e2b4f7845189d52bb590338e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908a3c0f-f1ef-48c9-8cc2-e2abe49e4861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908a3c0f-f1ef-48c9-8cc2-e2abe49e4861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897d1101-fefb-4953-989e-8c681fd23514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897d1101-fefb-4953-989e-8c681fd23514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad193683-f3d5-4fc3-945e-677a47b53944', 'volume_name': 'volume-ad193683-f3d5-4fc3-945e-677a47b53944', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69abde4e-f144-416c-8eac-5c93da20f1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69abde4e-f144-416c-8eac-5c93da20f1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df52cb1-524c-47f9-8352-b9843acdc8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:06 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Volume ad193683-f3d5-4fc3-945e-677a47b53944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad193683-f3d5-4fc3-945e-677a47b53944', 'volume_size': 1} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1608988829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad193683-f3d5-4fc3-945e-677a47b53944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093dc52c12e6448d81ffb7887c92601a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:06Z,use_quota=True,user_id='acc33e2b4f7845189d52bb590338e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Creating volume ad193683-f3d5-4fc3-945e-677a47b53944 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:27:06 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:06 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944 1073741824 Sep 11 21:27:06 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:06 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec 1G" returned: 0 in 0.342s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Downloaded image 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume 3bb90658-ed09-4409-ba8c-f109a78adeec successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 for user d4a2994ae89d4135af51a131f5a320d4 is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Marking volume 3bb90658-ed09-4409-ba8c-f109a78adeec as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Copying metadata from image 8333088b-528a-4438-98ec-37d49b129d98 to 3bb90658-ed09-4409-ba8c-f109a78adeec. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Creating volume glance metadata for volume 3bb90658-ed09-4409-ba8c-f109a78adeec backed by image 8333088b-528a-4438-98ec-37d49b129d98 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7058b1ec-8048-4abc-8a1d-d8d6236fe1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb90658-ed09-4409-ba8c-f109a78adeec', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a83969-12a8-4bc7-8b4f-65918567bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:06 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Volume volume-3bb90658-ed09-4409-ba8c-f109a78adeec (3bb90658-ed09-4409-ba8c-f109a78adeec): created successfully Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a83969-12a8-4bc7-8b4f-65918567bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Flow 'volume_create_manager' (3451acaa-4493-44d0-9650-1dcccd314777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-006e36c9-02ba-4977-9bab-53593c6834ae tempest-ServerActionsTestOtherA-316171242 None] Created volume successfully. Sep 11 21:27:06 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944 1073741824" returned: 0 in 0.451s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:06 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944 Sep 11 21:27:06 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:06 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944" returned: 0 in 0.280s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df52cb1-524c-47f9-8352-b9843acdc8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad193683-f3d5-4fc3-945e-677a47b53944', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf1b80b-8573-4ce2-83d0-4afc8d44ab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:06 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Volume volume-ad193683-f3d5-4fc3-945e-677a47b53944 (ad193683-f3d5-4fc3-945e-677a47b53944): created successfully Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf1b80b-8573-4ce2-83d0-4afc8d44ab91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Flow 'volume_create_manager' (35fb7f4d-a783-4597-be2b-ac7f6d3e5460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e70a9ef8-4516-468c-a0a8-175d4e4f4706 tempest-VolumesTransfersTest-378589268 None] Created volume successfully. Sep 11 21:27:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Acquiring lock "cinder-ad193683-f3d5-4fc3-945e-677a47b53944-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Lock "cinder-ad193683-f3d5-4fc3-945e-677a47b53944-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Acquiring lock "cinder-quobyte-ad193683-f3d5-4fc3-945e-677a47b53944" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Lock "cinder-quobyte-ad193683-f3d5-4fc3-945e-677a47b53944" acquired by "delete_volume" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:08 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[712e3820-da90-417e-949c-697169657dbb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:08 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944 Sep 11 21:27:08 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:09 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944" returned: 0 in 0.641s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:09 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944 Sep 11 21:27:09 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:09 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad193683-f3d5-4fc3-945e-677a47b53944" returned: 0 in 0.328s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Lock "cinder-quobyte-ad193683-f3d5-4fc3-945e-677a47b53944" released by "delete_volume" :: held 1.063s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Created reservations ['2a8c64d6-fe4b-4cb6-a893-d95b9a0c11b2', '7195a0f7-0b45-4cba-9ed0-b4ad7c3728f0', '6d1bc56b-1b29-46fb-932e-9ad0eb938702', '2253e831-57b2-4ec0-b71b-abcf95beb921'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:09 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:27:09 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:10 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.401s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:10 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:27:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Deleted volume successfully. Sep 11 21:27:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-12d84151-d5f5-434e-93b2-24e9a54a9b97 tempest-VolumesTransfersTest-1531512015 None] Lock "cinder-ad193683-f3d5-4fc3-945e-677a47b53944-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-42990b0a-9b21-4e5e-8819-7fd24580c9c4 req-be5a9c17-bd14-4c29-824e-2fad2240fc4a tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-42990b0a-9b21-4e5e-8819-7fd24580c9c4 req-be5a9c17-bd14-4c29-824e-2fad2240fc4a tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-42990b0a-9b21-4e5e-8819-7fd24580c9c4 req-be5a9c17-bd14-4c29-824e-2fad2240fc4a tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-42990b0a-9b21-4e5e-8819-7fd24580c9c4 req-be5a9c17-bd14-4c29-824e-2fad2240fc4a tempest-ServerActionsTestOtherA-316171242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-3bb90658-ed09-4409-ba8c-f109a78adeec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41f0a741-d413-4c93-9abf-d049418d5e95', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:27:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-42990b0a-9b21-4e5e-8819-7fd24580c9c4 req-be5a9c17-bd14-4c29-824e-2fad2240fc4a tempest-ServerActionsTestOtherA-316171242 None] attachment_update completed successfully. Sep 11 21:27:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:27:15 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 28 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:27:15 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:27:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Acquiring lock "cinder-83ecb33d-534b-4ef2-a9fa-c9205b02220a-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "cinder-83ecb33d-534b-4ef2-a9fa-c9205b02220a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Acquiring lock "cinder-quobyte-83ecb33d-534b-4ef2-a9fa-c9205b02220a" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "cinder-quobyte-83ecb33d-534b-4ef2-a9fa-c9205b02220a" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:19 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31c5b2d-f8e0-428b-bd78-922f630e8fd6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:19 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a Sep 11 21:27:19 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:19 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a" returned: 0 in 0.499s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:19 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a Sep 11 21:27:19 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:20 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-83ecb33d-534b-4ef2-a9fa-c9205b02220a" returned: 0 in 0.337s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "cinder-quobyte-83ecb33d-534b-4ef2-a9fa-c9205b02220a" released by "delete_volume" :: held 0.895s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Created reservations ['493e1fee-d1d4-4223-9a40-8532ab385985', 'd81ddcb8-1d60-4a31-be03-5cd9d47d85fa', '55e95f9d-fcb6-443b-bb68-9794e2ad4732', '925d37b0-e10f-4b23-a49d-1e21546da05d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:20 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:27:20 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:20 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.387s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:27:20 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Deleted volume successfully. Sep 11 21:27:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ffc62ae9-3d3b-4fb0-9c6c-fe438e28d8fc tempest-AttachVolumeShelveTestJSON-707886685 None] Lock "cinder-83ecb33d-534b-4ef2-a9fa-c9205b02220a-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (2886a100-4b2d-49ab-8862-6db03b16dbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67166045-194b-4e33-9023-a721fb19cf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67166045-194b-4e33-9023-a721fb19cf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-892448030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94ec246-a56f-447e-a054-e8ed5e4f5dad,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:24Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cffd421-45b4-4290-b787-82ee6761ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cffd421-45b4-4290-b787-82ee6761ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b599b03c-bbbd-4c40-8530-400e2bbad2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b599b03c-bbbd-4c40-8530-400e2bbad2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94ec246-a56f-447e-a054-e8ed5e4f5dad', 'volume_name': 'volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb03f075-266f-4c5f-a24b-4847412c20b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb03f075-266f-4c5f-a24b-4847412c20b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb885128-b1fe-43b2-9d48-e0822dad57e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:24 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Volume a94ec246-a56f-447e-a054-e8ed5e4f5dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad', 'volume_size': 1} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-892448030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94ec246-a56f-447e-a054-e8ed5e4f5dad,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:24Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Creating volume a94ec246-a56f-447e-a054-e8ed5e4f5dad {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:27:24 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:27:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:24 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad 1073741824 Sep 11 21:27:24 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:25 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad 1073741824" returned: 0 in 0.910s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:25 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad Sep 11 21:27:25 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:26 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:27:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb885128-b1fe-43b2-9d48-e0822dad57e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c7a980-7cf9-429a-bdae-5805440d6d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:26 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Volume volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad (a94ec246-a56f-447e-a054-e8ed5e4f5dad): created successfully Sep 11 21:27:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c7a980-7cf9-429a-bdae-5805440d6d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (2886a100-4b2d-49ab-8862-6db03b16dbe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:26 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-53eb6cdf-4fdf-45bf-a0a0-965bbdddc4c6 tempest-VolumesGetTest-755249506 None] Created volume successfully. Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (b6227d71-1025-43ec-867b-a435baf3e581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550154f7-44d6-4382-945d-f849d1bb1e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550154f7-44d6-4382-945d-f849d1bb1e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1681004281',display_name='tempest-VolumesGetTest-Volume-209061904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9accdad4-40b8-4887-b2b5-23621e65837d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:28Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17348e5b-71cd-49a2-9d8e-51614639a9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17348e5b-71cd-49a2-9d8e-51614639a9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fabcce-78a8-4741-a305-523c73a413dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fabcce-78a8-4741-a305-523c73a413dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9accdad4-40b8-4887-b2b5-23621e65837d', 'volume_name': 'volume-9accdad4-40b8-4887-b2b5-23621e65837d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c7f57f-6de4-4994-975a-2d5bf48a9b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c7f57f-6de4-4994-975a-2d5bf48a9b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d156df84-a6c4-4134-9ed9-aea5f8e1a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:28 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Volume 9accdad4-40b8-4887-b2b5-23621e65837d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9accdad4-40b8-4887-b2b5-23621e65837d', 'volume_size': 1} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1681004281',display_name='tempest-VolumesGetTest-Volume-209061904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9accdad4-40b8-4887-b2b5-23621e65837d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:28Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Creating volume 9accdad4-40b8-4887-b2b5-23621e65837d {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:27:28 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:27:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:28 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d 1073741824 Sep 11 21:27:28 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:29 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d 1073741824" returned: 0 in 0.802s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:29 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d Sep 11 21:27:29 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:29 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d" returned: 0 in 0.507s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:27:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d156df84-a6c4-4134-9ed9-aea5f8e1a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9accdad4-40b8-4887-b2b5-23621e65837d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce49908-e9a8-4baa-986a-d0ca1833b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:29 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Volume volume-9accdad4-40b8-4887-b2b5-23621e65837d (9accdad4-40b8-4887-b2b5-23621e65837d): created successfully Sep 11 21:27:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce49908-e9a8-4baa-986a-d0ca1833b372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (b6227d71-1025-43ec-867b-a435baf3e581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:29 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-974509d1-1737-4c83-8c17-a2e134608ec5 tempest-VolumesGetTest-755249506 None] Created volume successfully. Sep 11 21:27:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-9accdad4-40b8-4887-b2b5-23621e65837d-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Lock "cinder-9accdad4-40b8-4887-b2b5-23621e65837d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-quobyte-9accdad4-40b8-4887-b2b5-23621e65837d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-9accdad4-40b8-4887-b2b5-23621e65837d" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:30 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c7bec9-4646-450a-b213-730f25dbda40]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:30 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d Sep 11 21:27:30 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:31 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d" returned: 0 in 0.606s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:31 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d Sep 11 21:27:31 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-501e0650-6a86-48d4-9c00-6f034fd07b33 req-123e596d-95c4-4761-8a80-4117ab4ef316 tempest-ServerActionsTestOtherA-316171242 None] Terminate volume connection completed successfully. Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-501e0650-6a86-48d4-9c00-6f034fd07b33 req-123e596d-95c4-4761-8a80-4117ab4ef316 tempest-ServerActionsTestOtherA-316171242 None] Deleting attachment 41f0a741-d413-4c93-9abf-d049418d5e95. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:27:31 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9accdad4-40b8-4887-b2b5-23621e65837d" returned: 0 in 0.488s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-9accdad4-40b8-4887-b2b5-23621e65837d" released by "delete_volume" :: held 1.146s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Created reservations ['cefdfc2f-0840-4eba-9ae8-0a9eef28ef93', '28403b32-2feb-4ed3-b479-c218e04b620c', '4f596b74-65e7-4a29-af08-f2ee27fbbe88', 'b77bf3a3-a9ee-41b0-9dc2-95f105d938a9'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:31 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:27:31 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:32 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.313s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:32 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:27:32 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Deleted volume successfully. Sep 11 21:27:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ef321a70-6d7e-4dd4-9a6c-e8d8854c03fd tempest-VolumesGetTest-755249506 None] Lock "cinder-9accdad4-40b8-4887-b2b5-23621e65837d-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-a94ec246-a56f-447e-a054-e8ed5e4f5dad-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Lock "cinder-a94ec246-a56f-447e-a054-e8ed5e4f5dad-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-quobyte-a94ec246-a56f-447e-a054-e8ed5e4f5dad" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-a94ec246-a56f-447e-a054-e8ed5e4f5dad" acquired by "delete_volume" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:32 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7da887-d591-4f9d-9782-b14245e1f023]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:33 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad Sep 11 21:27:33 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-501e0650-6a86-48d4-9c00-6f034fd07b33 req-3116e5d5-7578-4ff8-89c1-51ac79570bd9 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-501e0650-6a86-48d4-9c00-6f034fd07b33 req-3116e5d5-7578-4ff8-89c1-51ac79570bd9 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-501e0650-6a86-48d4-9c00-6f034fd07b33 req-3116e5d5-7578-4ff8-89c1-51ac79570bd9 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-501e0650-6a86-48d4-9c00-6f034fd07b33 req-3116e5d5-7578-4ff8-89c1-51ac79570bd9 tempest-ServerActionsTestOtherA-316171242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-3bb90658-ed09-4409-ba8c-f109a78adeec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61945bad-21e5-4f86-ac52-fb2fdb5e6bac', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:27:33 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad" returned: 0 in 0.481s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:33 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad Sep 11 21:27:33 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:33 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-501e0650-6a86-48d4-9c00-6f034fd07b33 req-3116e5d5-7578-4ff8-89c1-51ac79570bd9 tempest-ServerActionsTestOtherA-316171242 None] attachment_update completed successfully. Sep 11 21:27:33 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a94ec246-a56f-447e-a054-e8ed5e4f5dad" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-a94ec246-a56f-447e-a054-e8ed5e4f5dad" released by "delete_volume" :: held 0.926s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Created reservations ['b2fa6c5c-ff83-4283-b0bb-4b08cb3f193a', '6e03996c-83b9-41ea-ae80-fb13e32f4c9c', 'f7bd7f9e-0c40-44c9-b336-54e2129fad17', '89258e8e-0352-4875-8dc9-689e6dfb33f6'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:34 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:27:34 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:34 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.408s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:34 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:27:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Deleted volume successfully. Sep 11 21:27:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c88a83e1-7886-42e2-a59c-a1c5518bff6b tempest-VolumesGetTest-755249506 None] Lock "cinder-a94ec246-a56f-447e-a054-e8ed5e4f5dad-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (ff801368-dfb8-42f7-b586-78b7f5e1c388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c355f3d-1cca-4727-9ce1-182ce7ea8e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c355f3d-1cca-4727-9ce1-182ce7ea8e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1248915567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ed0587-fdc3-415e-b902-e35cc4623bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:36Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f052a4bc-ff6e-4670-b136-59646abcaa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f052a4bc-ff6e-4670-b136-59646abcaa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282e5eee-68c3-4372-ad1e-003af06e063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282e5eee-68c3-4372-ad1e-003af06e063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ed0587-fdc3-415e-b902-e35cc4623bac', 'volume_name': 'volume-17ed0587-fdc3-415e-b902-e35cc4623bac', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26c23e0-972c-475b-8db6-326b811ed31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26c23e0-972c-475b-8db6-326b811ed31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef2a879-4ad5-4611-8b09-fde18aea7644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:35 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Volume 17ed0587-fdc3-415e-b902-e35cc4623bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ed0587-fdc3-415e-b902-e35cc4623bac', 'volume_size': 1} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1248915567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ed0587-fdc3-415e-b902-e35cc4623bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:36Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Creating volume 17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:27:35 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:27:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:35 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac 1073741824 Sep 11 21:27:35 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:36 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac 1073741824" returned: 0 in 0.805s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:36 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac Sep 11 21:27:36 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:37 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac" returned: 0 in 0.493s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef2a879-4ad5-4611-8b09-fde18aea7644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ed0587-fdc3-415e-b902-e35cc4623bac', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a2b885-d3f6-483f-8776-0d8f57fdd51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:37 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Volume volume-17ed0587-fdc3-415e-b902-e35cc4623bac (17ed0587-fdc3-415e-b902-e35cc4623bac): created successfully Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a2b885-d3f6-483f-8776-0d8f57fdd51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (ff801368-dfb8-42f7-b586-78b7f5e1c388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:37 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-baa3581e-e7ae-4ad2-b688-e2198b74b2c8 tempest-VolumesGetTest-755249506 None] Created volume successfully. Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Flow 'volume_create_manager' (116d0f03-e0d0-4763-b0fd-b67233d09b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae77dcc-bda1-41e8-aef7-7e6616358256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae77dcc-bda1-41e8-aef7-7e6616358256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1852920458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9907534-1e42-4794-8e09-7a9464e1cecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6597057d75b47e49f48acf1c7f32de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:37Z,use_quota=True,user_id='1a482fd14e304ddc895c128714b3aa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebe2f43-b1ff-43c2-8a0c-d480fc178cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebe2f43-b1ff-43c2-8a0c-d480fc178cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a209979d-443a-4c39-b18a-513ded8d9e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a209979d-443a-4c39-b18a-513ded8d9e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9907534-1e42-4794-8e09-7a9464e1cecb', 'volume_name': 'volume-a9907534-1e42-4794-8e09-7a9464e1cecb', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b823989-1e37-4f67-9be0-b540d67a9152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b823989-1e37-4f67-9be0-b540d67a9152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffed879a-1617-47d3-a36f-485744e4babc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:37 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Volume a9907534-1e42-4794-8e09-7a9464e1cecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9907534-1e42-4794-8e09-7a9464e1cecb', 'volume_size': 1} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1852920458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9907534-1e42-4794-8e09-7a9464e1cecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6597057d75b47e49f48acf1c7f32de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:37Z,use_quota=True,user_id='1a482fd14e304ddc895c128714b3aa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Creating volume a9907534-1e42-4794-8e09-7a9464e1cecb {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:27:37 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:27:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:37 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb 1073741824 Sep 11 21:27:37 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:38 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb 1073741824" returned: 0 in 1.116s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:38 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb Sep 11 21:27:38 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:27:39 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (bbeb22b5-fa40-42ac-b6ad-33681ad84615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f84e6b1-8298-4165-aff3-d5aded0a03f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb" returned: 0 in 0.824s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f84e6b1-8298-4165-aff3-d5aded0a03f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-263616912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b431ed13-746a-4306-8505-7588ed4ece23,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=17ed0587-fdc3-415e-b902-e35cc4623bac,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:39Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7725b1a-9e24-4abe-bd69-cc713624d1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7725b1a-9e24-4abe-bd69-cc713624d1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2b5efc-c79a-4647-a17f-cdd66783bf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffed879a-1617-47d3-a36f-485744e4babc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9907534-1e42-4794-8e09-7a9464e1cecb', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b3caad-a1e5-45b7-99ce-b7f7c71a4fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2b5efc-c79a-4647-a17f-cdd66783bf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b431ed13-746a-4306-8505-7588ed4ece23', 'volume_name': 'volume-b431ed13-746a-4306-8505-7588ed4ece23', 'volume_size': 1, 'source_volid': '17ed0587-fdc3-415e-b902-e35cc4623bac', 'source_volstatus': 'available'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52b559d-af6b-4576-8897-f321ae74fb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52b559d-af6b-4576-8897-f321ae74fb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c4ab3a-1834-4bd7-9ef7-a7d941d2a7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:39 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Volume b431ed13-746a-4306-8505-7588ed4ece23: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b431ed13-746a-4306-8505-7588ed4ece23', 'volume_size': 1, 'source_volid': '17ed0587-fdc3-415e-b902-e35cc4623bac', 'source_volstatus': 'available'} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:39 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Cloning volume 17ed0587-fdc3-415e-b902-e35cc4623bac to volume b431ed13-746a-4306-8505-7588ed4ece23 Sep 11 21:27:39 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Volume volume-a9907534-1e42-4794-8e09-7a9464e1cecb (a9907534-1e42-4794-8e09-7a9464e1cecb): created successfully Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b3caad-a1e5-45b7-99ce-b7f7c71a4fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Flow 'volume_create_manager' (116d0f03-e0d0-4763-b0fd-b67233d09b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d6f29c1e-50a0-46e0-87c5-63976134a23c tempest-AttachVolumeTestJSON-680445976 None] Created volume successfully. Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Creating offline snapshot 395dd72a-0c1a-4b63-8e32-0b711fff7c66 of volume 17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c24ca0-446a-48a0-9e3e-15158658ba21]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:40 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac Sep 11 21:27:40 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:40 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac" returned: 0 in 0.674s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:40 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 1G Sep 11 21:27:40 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:41 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 1G" returned: 0 in 0.926s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17ed0587-fdc3-415e-b902-e35cc4623bac -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:41 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17ed0587-fdc3-415e-b902-e35cc4623bac -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 Sep 11 21:27:41 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:42 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17ed0587-fdc3-415e-b902-e35cc4623bac -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66" returned: 0 in 0.568s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:42 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 is being set with open permissions: ugo+rw Sep 11 21:27:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:42 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 Sep 11 21:27:42 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-a7128381-964b-411d-ad8c-e533f993c0ca req-f92e44e9-f79a-46ec-8975-30956b65a6b4 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:42 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66" returned: 0 in 0.487s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:42 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.info Sep 11 21:27:42 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:43 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.info" returned: 0 in 0.668s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:43 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.info is being set with open permissions: ugo+rw Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:43 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.info Sep 11 21:27:43 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:43 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.info" returned: 0 in 0.485s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-quobyte-b431ed13-746a-4306-8505-7588ed4ece23" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-b431ed13-746a-4306-8505-7588ed4ece23" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] snapshot: 395dd72a-0c1a-4b63-8e32-0b711fff7c66, volume: b431ed13-746a-4306-8505-7588ed4ece23, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f79cd4-1db0-4496-ad11-d4ef4f6287fe]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:44 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 Sep 11 21:27:44 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:44 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66" returned: 0 in 0.464s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17ed0587-fdc3-415e-b902-e35cc4623bac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:27:44 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc6a7e3-8525-4f9a-bf02-1ea00e41f582]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:44 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac Sep 11 21:27:44 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:44 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac" returned: 0 in 0.407s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:27:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:27:44 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:27:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:44 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 Sep 11 21:27:44 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:52 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23" returned: 0 in 7.201s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:27:52 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Converted 1024.00 MB image at 142.17 MB/s Sep 11 21:27:52 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 is being set with open permissions: ugo+rw Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:52 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 Sep 11 21:27:52 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:52 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23" returned: 0 in 0.317s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-b431ed13-746a-4306-8505-7588ed4ece23" released by "_copy_volume_from_snapshot" :: held 8.516s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-quobyte-395dd72a-0c1a-4b63-8e32-0b711fff7c66" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-395dd72a-0c1a-4b63-8e32-0b711fff7c66" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Deleting offline snapshot 395dd72a-0c1a-4b63-8e32-0b711fff7c66 of volume 17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] snapshot_file for this snap is: volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7aafbe-249d-4fb4-b9e9-420f14b21f37]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:52 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 Sep 11 21:27:52 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=66,cinder:INSERT=23,cinder:UPDATE=72,cinder:DELETE=7 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:27:52 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66" returned: 0 in 0.416s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17ed0587-fdc3-415e-b902-e35cc4623bac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9538919-60cc-488e-9d2e-3f3950522af7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:53 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac Sep 11 21:27:53 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:53 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac" returned: 0 in 0.632s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:53 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 Sep 11 21:27:53 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:53 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66" returned: 0 in 0.420s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:54 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66 Sep 11 21:27:54 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:54 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac.395dd72a-0c1a-4b63-8e32-0b711fff7c66" returned: 0 in 0.282s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-395dd72a-0c1a-4b63-8e32-0b711fff7c66" released by "_delete_snapshot" :: held 1.869s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.582s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-a7128381-964b-411d-ad8c-e533f993c0ca req-f92e44e9-f79a-46ec-8975-30956b65a6b4 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-a7128381-964b-411d-ad8c-e533f993c0ca req-f92e44e9-f79a-46ec-8975-30956b65a6b4 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c4ab3a-1834-4bd7-9ef7-a7d941d2a7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b431ed13-746a-4306-8505-7588ed4ece23', 'volume_size': 1, 'source_volid': '17ed0587-fdc3-415e-b902-e35cc4623bac', 'source_volstatus': 'available'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea4f29c-d7af-4c2d-9174-51d2211b2843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:54 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Volume volume-b431ed13-746a-4306-8505-7588ed4ece23 (b431ed13-746a-4306-8505-7588ed4ece23): created successfully Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea4f29c-d7af-4c2d-9174-51d2211b2843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (bbeb22b5-fa40-42ac-b6ad-33681ad84615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-a7128381-964b-411d-ad8c-e533f993c0ca req-f92e44e9-f79a-46ec-8975-30956b65a6b4 tempest-AttachVolumeTestJSON-680445976 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-a9907534-1e42-4794-8e09-7a9464e1cecb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71328519-94cd-4848-9916-24d8eceb9d20', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:27:54 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a0bf8a1e-8870-4b7b-8702-3722c8344c3f tempest-VolumesGetTest-755249506 None] Created volume successfully. Sep 11 21:27:54 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-a7128381-964b-411d-ad8c-e533f993c0ca req-f92e44e9-f79a-46ec-8975-30956b65a6b4 tempest-AttachVolumeTestJSON-680445976 None] attachment_update completed successfully. Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (939fc67c-9e08-4dfd-bd9d-bb1258f22013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ed88f3-330f-4037-8e6a-2b53bdf9ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ed88f3-330f-4037-8e6a-2b53bdf9ebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2117349613',display_name='tempest-VolumesGetTest-Volume-1949407487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f2dab5-f488-4dca-ad16-9a858bfed19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:56Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9609b0-2305-43a5-b078-bce4cb4c7454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9609b0-2305-43a5-b078-bce4cb4c7454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba2838d-c7c2-4911-8895-c04d537b7cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba2838d-c7c2-4911-8895-c04d537b7cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f2dab5-f488-4dca-ad16-9a858bfed19f', 'volume_name': 'volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e0a2bb-4669-427a-9699-f82c095eb69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e0a2bb-4669-427a-9699-f82c095eb69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24facbf7-c43c-449f-907b-70da89d7ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:55 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Volume b4f2dab5-f488-4dca-ad16-9a858bfed19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f', 'volume_size': 1} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2117349613',display_name='tempest-VolumesGetTest-Volume-1949407487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f2dab5-f488-4dca-ad16-9a858bfed19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:56Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Creating volume b4f2dab5-f488-4dca-ad16-9a858bfed19f {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:27:55 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:27:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:55 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f 1073741824 Sep 11 21:27:55 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:56 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f 1073741824" returned: 0 in 0.561s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:56 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f Sep 11 21:27:56 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:27:56 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Flow 'volume_create_manager' (18ef9970-5ce6-46fa-8895-0b4a8e6e650b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1917873-1050-4dd7-ac99-c394ff137d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f" returned: 0 in 0.354s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1917873-1050-4dd7-ac99-c394ff137d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1407681120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87e2406-2fe4-4bf6-9825-4f04df7ab030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6597057d75b47e49f48acf1c7f32de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:57Z,use_quota=True,user_id='1a482fd14e304ddc895c128714b3aa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fca28e-3d17-4924-a412-675e9942c467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fca28e-3d17-4924-a412-675e9942c467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c098083-cb3d-4dbb-8fe0-55a0dbd59e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c098083-cb3d-4dbb-8fe0-55a0dbd59e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87e2406-2fe4-4bf6-9825-4f04df7ab030', 'volume_name': 'volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b20d2f4-677b-432d-888e-2732ce1871c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b20d2f4-677b-432d-888e-2732ce1871c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d865ba-7e0b-4f04-aaff-6e64c1b902d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:56 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Volume a87e2406-2fe4-4bf6-9825-4f04df7ab030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030', 'volume_size': 1} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1407681120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87e2406-2fe4-4bf6-9825-4f04df7ab030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6597057d75b47e49f48acf1c7f32de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:27:57Z,use_quota=True,user_id='1a482fd14e304ddc895c128714b3aa12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Creating volume a87e2406-2fe4-4bf6-9825-4f04df7ab030 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:27:56 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24facbf7-c43c-449f-907b-70da89d7ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6593c9fb-69e4-4cc9-9f6c-5f8ae2435034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Volume volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f (b4f2dab5-f488-4dca-ad16-9a858bfed19f): created successfully Sep 11 21:27:57 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 1073741824 Sep 11 21:27:57 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6593c9fb-69e4-4cc9-9f6c-5f8ae2435034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (939fc67c-9e08-4dfd-bd9d-bb1258f22013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-96c3235e-bcc8-4fc7-94c5-cd7ff9b9cfb9 tempest-VolumesGetTest-755249506 None] Created volume successfully. Sep 11 21:27:57 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 1073741824" returned: 0 in 0.561s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:57 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 Sep 11 21:27:57 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:57 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030" returned: 0 in 0.259s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d865ba-7e0b-4f04-aaff-6e64c1b902d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9b7225-498a-4cdd-8786-e861e47d8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:27:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Volume volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 (a87e2406-2fe4-4bf6-9825-4f04df7ab030): created successfully Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9b7225-498a-4cdd-8786-e861e47d8e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:27:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Flow 'volume_create_manager' (18ef9970-5ce6-46fa-8895-0b4a8e6e650b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:27:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-be36ae1e-9eae-44f3-8f1f-6dd0885f9551 tempest-AttachVolumeTestJSON-680445976 None] Created volume successfully. Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-b4f2dab5-f488-4dca-ad16-9a858bfed19f-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Lock "cinder-b4f2dab5-f488-4dca-ad16-9a858bfed19f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=81,cinder:UPDATE=69,cinder:INSERT=21,cinder:DELETE=7 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-quobyte-b4f2dab5-f488-4dca-ad16-9a858bfed19f" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-b4f2dab5-f488-4dca-ad16-9a858bfed19f" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd11ce5-8a94-43ea-8586-b3f07e527363]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:58 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f Sep 11 21:27:58 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:58 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f" returned: 0 in 0.387s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:58 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f Sep 11 21:27:58 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:58 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4f2dab5-f488-4dca-ad16-9a858bfed19f" returned: 0 in 0.294s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-b4f2dab5-f488-4dca-ad16-9a858bfed19f" released by "delete_volume" :: held 0.733s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Created reservations ['57d419ab-6a0b-4c91-8e32-ca882eff2e1b', 'ba6937d2-499c-4fdb-83d6-f3e3f2eefe80', '4221a6b9-64c3-4506-ab81-b5f72bf0b969', 'dc0049a9-685c-4c88-a838-d42639ed937a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:59 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:27:59 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-b431ed13-746a-4306-8505-7588ed4ece23-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Lock "cinder-b431ed13-746a-4306-8505-7588ed4ece23-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-quobyte-b431ed13-746a-4306-8505-7588ed4ece23" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-b431ed13-746a-4306-8505-7588ed4ece23" acquired by "delete_volume" :: waited 0.065s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5806b86d-221a-483c-a950-f99769883dbe]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:27:59 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.654s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:27:59 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:00 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Deleted volume successfully. Sep 11 21:28:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e6d2c5c0-8586-448a-989e-4e91e30f60c5 tempest-VolumesGetTest-755249506 None] Lock "cinder-b4f2dab5-f488-4dca-ad16-9a858bfed19f-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:00 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 Sep 11 21:28:00 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-82d35a2e-02a3-4dfb-adfb-6a869969d4ec req-4fa7f593-47e2-41ef-a018-33af4c1ee606 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-82d35a2e-02a3-4dfb-adfb-6a869969d4ec req-4fa7f593-47e2-41ef-a018-33af4c1ee606 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-82d35a2e-02a3-4dfb-adfb-6a869969d4ec req-4fa7f593-47e2-41ef-a018-33af4c1ee606 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-82d35a2e-02a3-4dfb-adfb-6a869969d4ec req-4fa7f593-47e2-41ef-a018-33af4c1ee606 tempest-AttachVolumeTestJSON-680445976 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28e15f35-4f09-4186-aa9d-cab4e57eacc9', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:28:00 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-82d35a2e-02a3-4dfb-adfb-6a869969d4ec req-4fa7f593-47e2-41ef-a018-33af4c1ee606 tempest-AttachVolumeTestJSON-680445976 None] attachment_update completed successfully. Sep 11 21:28:00 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23" returned: 0 in 0.807s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:00 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23 Sep 11 21:28:00 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:01 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b431ed13-746a-4306-8505-7588ed4ece23" returned: 0 in 0.371s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-b431ed13-746a-4306-8505-7588ed4ece23" released by "delete_volume" :: held 1.301s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Created reservations ['5aba6d11-c0e4-4ee5-abe9-dc3ec84c1db8', 'ac9d5860-2019-4200-bdb2-cd418486f5b1', '7bd95eb8-36d6-4548-86c4-1fadb440c172', '4c684f15-a5d6-4c9f-9d0c-21dd45da94d9'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:01 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:01 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:01 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.369s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Deleted volume successfully. Sep 11 21:28:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-55b4cec9-eead-4ceb-82e6-cff9080c4203 tempest-VolumesGetTest-755249506 None] Lock "cinder-b431ed13-746a-4306-8505-7588ed4ece23-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-17ed0587-fdc3-415e-b902-e35cc4623bac-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Lock "cinder-17ed0587-fdc3-415e-b902-e35cc4623bac-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-quobyte-17ed0587-fdc3-415e-b902-e35cc4623bac" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-17ed0587-fdc3-415e-b902-e35cc4623bac" acquired by "delete_volume" :: waited 0.032s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:02 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d7ab2b-ba31-4ca0-ade1-74adfd08bc6f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:02 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac Sep 11 21:28:02 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:02 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac" returned: 0 in 0.495s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:02 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac Sep 11 21:28:02 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:03 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-17ed0587-fdc3-415e-b902-e35cc4623bac" returned: 0 in 0.365s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-17ed0587-fdc3-415e-b902-e35cc4623bac" released by "delete_volume" :: held 0.943s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Created reservations ['c0d089dc-6fc3-425a-b96e-270f7845faf9', '4a153433-7ce1-445f-b602-3cd7ccad2f62', '425fd0c4-972a-4c15-8eff-5f2ccd88a512', '74afb710-5d70-47a9-92d4-93f6b4effc81'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:03 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:03 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-e6e86d91-07d1-4219-a2f1-489f916f8e6c req-f91e8267-981e-4906-84d2-5add97016d75 tempest-AttachVolumeTestJSON-680445976 None] Terminate volume connection completed successfully. Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-e6e86d91-07d1-4219-a2f1-489f916f8e6c req-f91e8267-981e-4906-84d2-5add97016d75 tempest-AttachVolumeTestJSON-680445976 None] Deleting attachment 71328519-94cd-4848-9916-24d8eceb9d20. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:28:03 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.399s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Deleted volume successfully. Sep 11 21:28:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8627013e-1269-4214-a02a-bf2c840f2e39 tempest-VolumesGetTest-755249506 None] Lock "cinder-17ed0587-fdc3-415e-b902-e35cc4623bac-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-7f64335a-feb1-4ea6-833a-04e1d7945ccb req-9a59ac73-52fb-4495-9bfa-a526de1f1276 tempest-AttachVolumeTestJSON-680445976 None] Terminate volume connection completed successfully. Sep 11 21:28:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-7f64335a-feb1-4ea6-833a-04e1d7945ccb req-9a59ac73-52fb-4495-9bfa-a526de1f1276 tempest-AttachVolumeTestJSON-680445976 None] Deleting attachment 28e15f35-4f09-4186-aa9d-cab4e57eacc9. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:28:05 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:28:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (bb0549fe-048a-412a-8884-5c4bac57d7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afafe7a-6da4-4b5d-b7fc-f1244aafa5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afafe7a-6da4-4b5d-b7fc-f1244aafa5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1916949867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d70beb-b319-4ae0-9caf-91e8ade66568,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:06Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bb1199-e358-4942-a0f5-ac1c4a320713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bb1199-e358-4942-a0f5-ac1c4a320713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b5b5e0-774d-4e4c-9460-0cdf9be7c0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:05 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:28:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b5b5e0-774d-4e4c-9460-0cdf9be7c0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54d70beb-b319-4ae0-9caf-91e8ade66568', 'volume_name': 'volume-54d70beb-b319-4ae0-9caf-91e8ade66568', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4089f2-0ab7-46b2-a07f-69a411330072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4089f2-0ab7-46b2-a07f-69a411330072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8bd07d-8066-4658-bfe6-37d4824ca83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:06 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Volume 54d70beb-b319-4ae0-9caf-91e8ade66568: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54d70beb-b319-4ae0-9caf-91e8ade66568', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 21:28:06 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Trying to clone 54d70beb-b319-4ae0-9caf-91e8ade66568 from image 8333088b-528a-4438-98ec-37d49b129d98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:28:06 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:28:06 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Image download 20.69 MB at 20.69 MB/s Sep 11 21:28:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20038d0-2b19-4c57-af4f-9cde735c44a5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:07 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD Sep 11 21:28:07 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:08 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 is fetched for user 953c75b33b0e48ae9c1247de3215170a. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca7dbdf-184c-48c6-97e4-bb8d334315cf]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:08 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD Sep 11 21:28:08 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:08 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1916949867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d70beb-b319-4ae0-9caf-91e8ade66568,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:06Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Creating volume 54d70beb-b319-4ae0-9caf-91e8ade66568 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:28:08 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:28:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:08 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 1073741824 Sep 11 21:28:08 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-af9177cd-6d48-47cf-9843-15f5a355d8b5 tempest-ServerActionsTestOtherA-316171242 None] Terminate volume connection completed successfully. Sep 11 21:28:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-af9177cd-6d48-47cf-9843-15f5a355d8b5 tempest-ServerActionsTestOtherA-316171242 None] Deleting attachment 61945bad-21e5-4f86-ac52-fb2fdb5e6bac. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:28:09 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 1073741824" returned: 0 in 0.963s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "cinder-3bb90658-ed09-4409-ba8c-f109a78adeec-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:09 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 Sep 11 21:28:09 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Lock "cinder-3bb90658-ed09-4409-ba8c-f109a78adeec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "cinder-quobyte-3bb90658-ed09-4409-ba8c-f109a78adeec" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Lock "cinder-quobyte-3bb90658-ed09-4409-ba8c-f109a78adeec" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:09 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b593d-fa7e-4ad6-bdca-8c765434592b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:10 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec Sep 11 21:28:10 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:10 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568" returned: 0 in 0.808s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:28:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:10 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Attempting download of 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume 54d70beb-b319-4ae0-9caf-91e8ade66568. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:28:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f70da7a-cf93-4994-8f8d-3af79fd45417]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_xd29nu6z {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "cinder-a780032e-f576-477c-a0ad-859b8615923a-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Lock "cinder-a780032e-f576-477c-a0ad-859b8615923a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "cinder-quobyte-a780032e-f576-477c-a0ad-859b8615923a" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:11 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_xd29nu6z Sep 11 21:28:11 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Lock "cinder-quobyte-a780032e-f576-477c-a0ad-859b8615923a" acquired by "delete_volume" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:11 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec" returned: 0 in 1.136s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ef2bac-d6b9-4f2b-b8e4-26bd180b43f4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:11 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec Sep 11 21:28:11 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:11 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3bb90658-ed09-4409-ba8c-f109a78adeec" returned: 0 in 0.413s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:11 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a Sep 11 21:28:11 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Lock "cinder-quobyte-3bb90658-ed09-4409-ba8c-f109a78adeec" released by "delete_volume" :: held 1.634s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG cinder.quota [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Created reservations ['23d2795b-41e8-421b-bfd8-4b39caad6b28', '4fc82188-1fab-491a-98be-c967a9d7fa75', '66512611-6a51-4283-98b1-0723ab94e3b8', 'a5d9f333-ac7f-4433-8b95-e33447d4bb0e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:11 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_xd29nu6z" returned: 0 in 1.018s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_xd29nu6z {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:11 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:11 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:11 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a" returned: 0 in 0.858s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:11 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a Sep 11 21:28:11 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:11 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_xd29nu6z Sep 11 21:28:11 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:12 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_xd29nu6z" returned: 1 in 0.644s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_xd29nu6z' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffde822-b317-4c37-aa1b-9914d4a72fa4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:12 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.653s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG cinder.manager [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Deleted volume successfully. Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-eca13ec1-07c0-43d8-a319-25d21525e207 req-eca4481a-cb20-49a0-8529-cacaaee75357 tempest-ServerActionsTestOtherA-316171242 None] Lock "cinder-3bb90658-ed09-4409-ba8c-f109a78adeec-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:12 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a780032e-f576-477c-a0ad-859b8615923a" returned: 0 in 0.714s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Lock "cinder-quobyte-a780032e-f576-477c-a0ad-859b8615923a" released by "delete_volume" :: held 1.654s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:12 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD Sep 11 21:28:12 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Created reservations ['6e97a12f-36eb-4382-9d99-b1f7ec804b39', '9b7c15d0-7708-4328-bca0-5ce26d0b5772', '47f14046-edf7-4ff3-ba2b-f36970497b76', 'a8214e19-9720-4940-bbdb-7dc19f854e7b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:12 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:12 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:12 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] 8333088b-528a-4438-98ec-37d49b129d98 was qcow2, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:28:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:13 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 Sep 11 21:28:13 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:13 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.375s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:13 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:13 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Deleted volume successfully. Sep 11 21:28:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4e251e90-0f03-44a2-ae99-ce7447183275 tempest-ServerActionsTestOtherA-316171242 None] Lock "cinder-a780032e-f576-477c-a0ad-859b8615923a-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "cinder-a87e2406-2fe4-4bf6-9825-4f04df7ab030-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-a87e2406-2fe4-4bf6-9825-4f04df7ab030-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "cinder-quobyte-a87e2406-2fe4-4bf6-9825-4f04df7ab030" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-quobyte-a87e2406-2fe4-4bf6-9825-4f04df7ab030" acquired by "delete_volume" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[688fffa2-eb20-4adf-b5c2-188ed6793b04]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:15 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568" returned: 0 in 2.618s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_535a12xgdevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:28:15 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Converted 112.00 MB image at 42.77 MB/s Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:15 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 1G Sep 11 21:28:15 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:15 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 Sep 11 21:28:15 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:15 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:15 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:16 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.351s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 28 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:28:16 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030" returned: 0 in 0.570s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:16 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:16 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030 Sep 11 21:28:16 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 1G" returned: 0 in 0.557s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Downloaded image 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume 54d70beb-b319-4ae0-9caf-91e8ade66568 successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 for user 953c75b33b0e48ae9c1247de3215170a is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Marking volume 54d70beb-b319-4ae0-9caf-91e8ade66568 as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Copying metadata from image 8333088b-528a-4438-98ec-37d49b129d98 to 54d70beb-b319-4ae0-9caf-91e8ade66568. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Creating volume glance metadata for volume 54d70beb-b319-4ae0-9caf-91e8ade66568 backed by image 8333088b-528a-4438-98ec-37d49b129d98 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8bd07d-8066-4658-bfe6-37d4824ca83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d70beb-b319-4ae0-9caf-91e8ade66568', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b40686c-ac36-4d03-bdf9-50b625894f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:16 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Volume volume-54d70beb-b319-4ae0-9caf-91e8ade66568 (54d70beb-b319-4ae0-9caf-91e8ade66568): created successfully Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b40686c-ac36-4d03-bdf9-50b625894f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (bb0549fe-048a-412a-8884-5c4bac57d7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4838ef1c-6126-479b-978e-edc611f5ad7e tempest-VolumesGetTest-755249506 None] Created volume successfully. Sep 11 21:28:16 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a87e2406-2fe4-4bf6-9825-4f04df7ab030" returned: 0 in 0.284s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-quobyte-a87e2406-2fe4-4bf6-9825-4f04df7ab030" released by "delete_volume" :: held 0.895s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Created reservations ['8735fe15-3b57-4236-8ab9-a39da23820b1', '168ae2c2-509a-4c9d-a8f4-09a0903eeedf', 'c72d49df-a29a-47d0-9f7e-1413fb9b28fb', '8df2dd04-07cc-4a27-bd78-b3cedbfe3f17'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:16 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:16 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "cinder-a9907534-1e42-4794-8e09-7a9464e1cecb-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-a9907534-1e42-4794-8e09-7a9464e1cecb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "cinder-quobyte-a9907534-1e42-4794-8e09-7a9464e1cecb" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-quobyte-a9907534-1e42-4794-8e09-7a9464e1cecb" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c6cb05-146a-4852-897c-f47308dcfb8a]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:16 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.287s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Deleted volume successfully. Sep 11 21:28:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-42155413-65c7-49a1-9e0a-b42abdbcb514 tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-a87e2406-2fe4-4bf6-9825-4f04df7ab030-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:16 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb Sep 11 21:28:16 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:17 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb" returned: 0 in 0.389s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:17 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb Sep 11 21:28:17 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:17 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a9907534-1e42-4794-8e09-7a9464e1cecb" returned: 0 in 0.289s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-quobyte-a9907534-1e42-4794-8e09-7a9464e1cecb" released by "delete_volume" :: held 0.744s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Created reservations ['0a8257e1-104a-41ca-8ec9-c060da1375bb', 'ac00e358-9a1d-4c0a-bab3-60fb7248b7b9', 'a8fedf46-57c4-438a-9567-1eda60d1f691', '14e47067-0f53-440b-aaf3-a8a712c99cab'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:17 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:17 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (3764a445-f4b8-49ec-9268-725d186cf641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cc8db0-411d-4730-8d8a-724f248dfbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cc8db0-411d-4730-8d8a-724f248dfbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-316271678',display_name='tempest-VolumesGetTest-Volume-470062847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5aae98e-9d8b-446d-b168-05086c3c6880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:18Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54307fb-fa0c-4c65-9a60-f991e716549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54307fb-fa0c-4c65-9a60-f991e716549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569d93d5-e55a-4fb5-95c8-883b2d2987ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569d93d5-e55a-4fb5-95c8-883b2d2987ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5aae98e-9d8b-446d-b168-05086c3c6880', 'volume_name': 'volume-e5aae98e-9d8b-446d-b168-05086c3c6880', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91616ff2-17f8-4675-bf45-abc817d3e892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91616ff2-17f8-4675-bf45-abc817d3e892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb6fcd3-d281-4c58-a183-36208332f304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:17 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Volume e5aae98e-9d8b-446d-b168-05086c3c6880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5aae98e-9d8b-446d-b168-05086c3c6880', 'volume_size': 1} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-316271678',display_name='tempest-VolumesGetTest-Volume-470062847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5aae98e-9d8b-446d-b168-05086c3c6880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1dc64b0a4a4ff8ae1f981a9c7e9ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:18Z,use_quota=True,user_id='953c75b33b0e48ae9c1247de3215170a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Creating volume e5aae98e-9d8b-446d-b168-05086c3c6880 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:28:17 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:28:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:17 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880 1073741824 Sep 11 21:28:17 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:18 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.337s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "cinder-48effd5e-1c7a-470e-acee-430bc352c80b-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:18 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Deleted volume successfully. Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-48effd5e-1c7a-470e-acee-430bc352c80b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8fd8eb1-4618-4ebf-b257-00b300f9a3d6 tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-a9907534-1e42-4794-8e09-7a9464e1cecb-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "cinder-quobyte-48effd5e-1c7a-470e-acee-430bc352c80b" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-quobyte-48effd5e-1c7a-470e-acee-430bc352c80b" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[54486693-f026-4eae-ad2f-dacb25284258]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:18 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b Sep 11 21:28:18 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:18 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880 1073741824" returned: 0 in 0.553s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:18 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880 Sep 11 21:28:18 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:18 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b" returned: 0 in 0.432s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:18 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b Sep 11 21:28:18 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:18 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880" returned: 0 in 0.270s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb6fcd3-d281-4c58-a183-36208332f304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5aae98e-9d8b-446d-b168-05086c3c6880', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce793fa-89a1-4b62-85ac-a6c151582e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:18 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Volume volume-e5aae98e-9d8b-446d-b168-05086c3c6880 (e5aae98e-9d8b-446d-b168-05086c3c6880): created successfully Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce793fa-89a1-4b62-85ac-a6c151582e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Flow 'volume_create_manager' (3764a445-f4b8-49ec-9268-725d186cf641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:18 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5be19a42-9af1-4a5e-881e-6ca0c219dbc5 tempest-VolumesGetTest-755249506 None] Created volume successfully. Sep 11 21:28:18 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-48effd5e-1c7a-470e-acee-430bc352c80b" returned: 0 in 0.275s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-quobyte-48effd5e-1c7a-470e-acee-430bc352c80b" released by "delete_volume" :: held 0.750s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:18 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Created reservations ['3919bb54-7083-412f-8ea2-23658f23c3a3', '9ca2de57-85c3-4f46-ae89-bd107523173a', '4f1ffd75-f6bc-441c-bf94-529a8879ea11', '076ee0f7-f0f4-4c87-a101-9a39dc52c897'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:19 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:19 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:19 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.337s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:19 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Deleted volume successfully. Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ce1cdce4-8eed-4317-8e26-1b18fc856eae tempest-AttachVolumeTestJSON-680445976 None] Lock "cinder-48effd5e-1c7a-470e-acee-430bc352c80b-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-e5aae98e-9d8b-446d-b168-05086c3c6880-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Lock "cinder-e5aae98e-9d8b-446d-b168-05086c3c6880-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-quobyte-e5aae98e-9d8b-446d-b168-05086c3c6880" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-e5aae98e-9d8b-446d-b168-05086c3c6880" acquired by "delete_volume" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a6dedf-5f67-43b6-8efb-3e28a6a86fee]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:20 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880 Sep 11 21:28:20 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:20 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880" returned: 0 in 0.410s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:20 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880 Sep 11 21:28:20 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:20 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e5aae98e-9d8b-446d-b168-05086c3c6880" returned: 0 in 0.260s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-e5aae98e-9d8b-446d-b168-05086c3c6880" released by "delete_volume" :: held 0.739s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Created reservations ['9c4eeb05-44f0-4cd2-8874-5fa6de9557c3', '48c4f5ef-5282-490e-bd66-7eed7c63d33d', '5636d4b5-2e9d-41d9-b631-102bf5032d8f', '3127a1cd-020d-4afb-96f5-fbf968ab59ae'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:21 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:21 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:21 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.284s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Deleted volume successfully. Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-54d70beb-b319-4ae0-9caf-91e8ade66568-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-36eb9055-2f96-4ae6-acf4-bc288bf20564 tempest-VolumesGetTest-755249506 None] Lock "cinder-e5aae98e-9d8b-446d-b168-05086c3c6880-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Lock "cinder-54d70beb-b319-4ae0-9caf-91e8ade66568-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Acquiring lock "cinder-quobyte-54d70beb-b319-4ae0-9caf-91e8ade66568" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-54d70beb-b319-4ae0-9caf-91e8ade66568" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efd7d3e-188c-4847-a4ed-19e18e67f795]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:21 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 Sep 11 21:28:21 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:21 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568" returned: 0 in 0.466s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:22 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568 Sep 11 21:28:22 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:22 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-54d70beb-b319-4ae0-9caf-91e8ade66568" returned: 0 in 0.417s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Lock "cinder-quobyte-54d70beb-b319-4ae0-9caf-91e8ade66568" released by "delete_volume" :: held 0.958s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Created reservations ['cc76be3b-7677-4ad5-932a-4529b8ba2df4', 'd43ee6ec-5ed3-4678-82b6-e8a349fcfa0f', 'a9d153c2-6ca6-483d-9e27-9ced1f30cf66', '1299b804-f84d-42c3-97c8-c75c2176af55'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:22 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:22 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:22 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.282s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Deleted volume successfully. Sep 11 21:28:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-337879f6-612f-41c6-9dc3-c2cbd4bd4de8 tempest-VolumesGetTest-755249506 None] Lock "cinder-54d70beb-b319-4ae0-9caf-91e8ade66568-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Flow 'volume_create_manager' (2737965d-d0a2-4d8f-86c7-f4096e4e791c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b28e429-00d8-4618-ab41-1f93f6f32ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b28e429-00d8-4618-ab41-1f93f6f32ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1712655689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fcd84d-0389-4ddd-a366-4ec6e72cad1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e17b521db643249bf19c1ff277c77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:25Z,use_quota=True,user_id='291740fd7eba49a3bf4ef155f69c8a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f526f1b-e3a9-4588-871b-eff9faa72f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f526f1b-e3a9-4588-871b-eff9faa72f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd425b72-099d-4db3-a483-f59f61fddd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd425b72-099d-4db3-a483-f59f61fddd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19fcd84d-0389-4ddd-a366-4ec6e72cad1c', 'volume_name': 'volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea4e000-b36d-4184-93b3-dfd7ddae291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea4e000-b36d-4184-93b3-dfd7ddae291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d725d8-faf3-41e8-98dd-400f2b1ce2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:25 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Volume 19fcd84d-0389-4ddd-a366-4ec6e72cad1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c', 'volume_size': 1} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1712655689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19fcd84d-0389-4ddd-a366-4ec6e72cad1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e17b521db643249bf19c1ff277c77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:25Z,use_quota=True,user_id='291740fd7eba49a3bf4ef155f69c8a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Creating volume 19fcd84d-0389-4ddd-a366-4ec6e72cad1c {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:28:25 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:28:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:25 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c 1073741824 Sep 11 21:28:25 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:26 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c 1073741824" returned: 0 in 0.586s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:26 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c Sep 11 21:28:26 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:26 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c" returned: 0 in 0.276s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:28:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d725d8-faf3-41e8-98dd-400f2b1ce2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606ff53f-73ae-45af-b192-9045870a1b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:26 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Volume volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c (19fcd84d-0389-4ddd-a366-4ec6e72cad1c): created successfully Sep 11 21:28:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606ff53f-73ae-45af-b192-9045870a1b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Flow 'volume_create_manager' (2737965d-d0a2-4d8f-86c7-f4096e4e791c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:26 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ff5e853f-5e7b-435d-add8-8a1525595cdd tempest-AttachVolumeNegativeTest-717306620 None] Created volume successfully. Sep 11 21:28:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-341db198-6384-4017-8bc4-e586dc922759 req-8160ff85-63fd-4faa-a5b9-212cd651bd14 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-341db198-6384-4017-8bc4-e586dc922759 req-8160ff85-63fd-4faa-a5b9-212cd651bd14 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-341db198-6384-4017-8bc4-e586dc922759 req-8160ff85-63fd-4faa-a5b9-212cd651bd14 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-341db198-6384-4017-8bc4-e586dc922759 req-8160ff85-63fd-4faa-a5b9-212cd651bd14 tempest-AttachVolumeNegativeTest-717306620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '344fef3a-9ce1-493b-bde6-7674fa41fa86', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:28:28 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-341db198-6384-4017-8bc4-e586dc922759 req-8160ff85-63fd-4faa-a5b9-212cd651bd14 tempest-AttachVolumeNegativeTest-717306620 None] attachment_update completed successfully. Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Flow 'volume_create_manager' (437a0e6e-58e8-4c7e-8626-0bf398a86c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b129ce2-880d-420e-922d-309ef663c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b129ce2-880d-420e-922d-309ef663c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1170283998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27a2d70-e6b5-45b0-aa04-1c5d5be89d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628ad95a68743d0a687ba93d8b9c09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:30Z,use_quota=True,user_id='7339f3e652f141e591e732c2f024551d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de223217-f13a-4813-b178-b9119afc1bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de223217-f13a-4813-b178-b9119afc1bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8e077d-4f2e-4e76-9431-6b44c79892de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8e077d-4f2e-4e76-9431-6b44c79892de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27a2d70-e6b5-45b0-aa04-1c5d5be89d17', 'volume_name': 'volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcfa4f1-ee8c-47e9-a18b-16407fcb2161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcfa4f1-ee8c-47e9-a18b-16407fcb2161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398e8e4c-3691-4626-b20f-1c2e7c27c808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Volume e27a2d70-e6b5-45b0-aa04-1c5d5be89d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17', 'volume_size': 1} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1170283998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27a2d70-e6b5-45b0-aa04-1c5d5be89d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628ad95a68743d0a687ba93d8b9c09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:30Z,use_quota=True,user_id='7339f3e652f141e591e732c2f024551d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Creating volume e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:28:29 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:29 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 1073741824 Sep 11 21:28:29 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Flow 'volume_create_manager' (f656296b-106d-4f47-9d9b-61b268144478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5998c2d-511d-4b0a-a069-c7e69c519fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5998c2d-511d-4b0a-a069-c7e69c519fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1478165568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a8aeb4-db0f-4f33-9176-c2d45bf87784,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee18460e1eec4379898b7aec5e7f1930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:30Z,use_quota=True,user_id='56026093a5084d92aad8249371c8f078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b646ac2b-a8eb-42d8-8794-686d27ddf4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b646ac2b-a8eb-42d8-8794-686d27ddf4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8515cca9-894a-447f-be85-389dbfa72cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8515cca9-894a-447f-be85-389dbfa72cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a8aeb4-db0f-4f33-9176-c2d45bf87784', 'volume_name': 'volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9cd579-d4f1-4274-9860-c5835ca21911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9cd579-d4f1-4274-9860-c5835ca21911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf96263-fc1c-41d1-93b3-68d3f1bae4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:29 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Volume a8a8aeb4-db0f-4f33-9176-c2d45bf87784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784', 'volume_size': 1} Sep 11 21:28:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:30 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 1073741824" returned: 0 in 0.488s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:30 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 Sep 11 21:28:30 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:30 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" returned: 0 in 0.318s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1478165568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a8aeb4-db0f-4f33-9176-c2d45bf87784,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee18460e1eec4379898b7aec5e7f1930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:30Z,use_quota=True,user_id='56026093a5084d92aad8249371c8f078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Creating volume a8a8aeb4-db0f-4f33-9176-c2d45bf87784 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:28:30 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398e8e4c-3691-4626-b20f-1c2e7c27c808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:30 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 1073741824 Sep 11 21:28:30 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c4c6ec-b855-4795-92d1-1787ae52073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:30 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Volume volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 (e27a2d70-e6b5-45b0-aa04-1c5d5be89d17): created successfully Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c4c6ec-b855-4795-92d1-1787ae52073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Flow 'volume_create_manager' (437a0e6e-58e8-4c7e-8626-0bf398a86c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:30 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-11f83f6c-f21e-45f2-8d97-2518d0e79f45 tempest-VolumesSnapshotListTestJSON-957035900 None] Created volume successfully. Sep 11 21:28:31 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 1073741824" returned: 0 in 0.567s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:31 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 Sep 11 21:28:31 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:31 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784" returned: 0 in 0.328s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf96263-fc1c-41d1-93b3-68d3f1bae4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed0071a-d7e2-4d3d-a410-11bfe7b6198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:31 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Volume volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 (a8a8aeb4-db0f-4f33-9176-c2d45bf87784): created successfully Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed0071a-d7e2-4d3d-a410-11bfe7b6198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Flow 'volume_create_manager' (f656296b-106d-4f47-9d9b-61b268144478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-daa8aa5e-c314-43f5-8f74-a5252d3394f7 req-b959de46-2997-4e93-85a6-0d243368b7b9 tempest-VolumesGetTestJSON-307656699 None] Created volume successfully. Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Creating offline snapshot 6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 of volume e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7675ed-a162-4e37-a9bc-de28aa7c30b8]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:31 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 Sep 11 21:28:31 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:32 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" returned: 0 in 0.434s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:32 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 1G Sep 11 21:28:32 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Acquiring lock "cinder-a8a8aeb4-db0f-4f33-9176-c2d45bf87784-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Lock "cinder-a8a8aeb4-db0f-4f33-9176-c2d45bf87784-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Acquiring lock "cinder-quobyte-a8a8aeb4-db0f-4f33-9176-c2d45bf87784" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Lock "cinder-quobyte-a8a8aeb4-db0f-4f33-9176-c2d45bf87784" acquired by "delete_volume" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d3e532-81d0-4200-b7f7-7f7c42082420]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:32 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 Sep 11 21:28:32 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:32 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 1G" returned: 0 in 0.576s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:32 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 Sep 11 21:28:32 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-760f592d-333e-4314-bfae-7cf00597dc2a tempest-BackendsCapabilitiesAdminTestsJSON-322901513 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2010765075684, 'free_capacity_gb': 1773.2010765075684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87423) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 21:28:32 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784" returned: 0 in 0.472s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da9d8fb2-ee66-4456-9840-f6bac617bf91 tempest-BackendsCapabilitiesAdminTestsJSON-322901513 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2010765075684, 'free_capacity_gb': 1773.2010765075684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87423) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 21:28:33 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784 Sep 11 21:28:33 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:33 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" returned: 0 in 0.383s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:33 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 is being set with open permissions: ugo+rw Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:33 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 Sep 11 21:28:33 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:33 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a8a8aeb4-db0f-4f33-9176-c2d45bf87784" returned: 0 in 0.321s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Lock "cinder-quobyte-a8a8aeb4-db0f-4f33-9176-c2d45bf87784" released by "delete_volume" :: held 0.861s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG cinder.quota [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Created reservations ['0f29d7e0-b32b-4e91-984d-c4b5e1e0f86a', 'a30018b2-f5ad-4bb5-ae25-a2fda4a234bb', '7fc4e508-f2f1-46c4-9982-0c1c7936aa5f', 'ec884739-7220-4bc2-aef3-d48f59354660'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:33 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" returned: 0 in 0.315s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:33 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:33 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:33 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.info Sep 11 21:28:33 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:33 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.426s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:34 devstack cinder-volume[87423]: DEBUG cinder.manager [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Deleted volume successfully. Sep 11 21:28:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-cdffaf14-4d7f-48e1-8249-fdf9902f7de1 req-dcf77ece-1c14-4e26-8322-434352fb35ac tempest-VolumesGetTestJSON-307656699 None] Lock "cinder-a8a8aeb4-db0f-4f33-9176-c2d45bf87784-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:34 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.info" returned: 0 in 0.492s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:34 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.info is being set with open permissions: ugo+rw Sep 11 21:28:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:34 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.info Sep 11 21:28:34 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:34 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.info" returned: 0 in 0.333s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-48c805b7-0c17-4b19-901e-e291942f5c95 tempest-VolumesSnapshotListTestJSON-957035900 None] Create snapshot completed successfully Sep 11 21:28:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Creating offline snapshot c07bb171-0cf3-4eeb-8d88-40d09c6ef67f of volume e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:28:35 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59f9168-65b1-41e9-8a06-7d35456001ff]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:35 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 Sep 11 21:28:35 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:35 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" returned: 0 in 0.585s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:28:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:35 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f 1G Sep 11 21:28:35 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:36 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f 1G" returned: 0 in 0.673s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:36 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f Sep 11 21:28:36 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:36 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" returned: 0 in 0.458s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:36 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f is being set with open permissions: ugo+rw Sep 11 21:28:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:37 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f Sep 11 21:28:37 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:37 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" returned: 0 in 0.335s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:37 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b1e1d66b-99c2-4a14-bc84-734d8dce9eca tempest-VolumesSnapshotListTestJSON-957035900 None] Create snapshot completed successfully Sep 11 21:28:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Creating offline snapshot 909cbecd-1270-4ede-8035-368b628b9c21 of volume e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:28:38 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7149a822-8f77-4a7b-9f64-afe349ad201a]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:38 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f Sep 11 21:28:38 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:39 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" returned: 0 in 0.452s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:39 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:28:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:39 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 1G Sep 11 21:28:39 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:40 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 1G" returned: 0 in 1.019s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:40 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 Sep 11 21:28:40 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:40 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21" returned: 0 in 0.563s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:40 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 is being set with open permissions: ugo+rw Sep 11 21:28:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:40 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 Sep 11 21:28:40 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:41 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21" returned: 0 in 0.418s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d29f2797-462b-4a28-aa73-7b13cac35f56 tempest-VolumesSnapshotListTestJSON-957035900 None] Create snapshot completed successfully Sep 11 21:28:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5e223b0d-9adc-4d89-afdf-56e23e3a853d tempest-GroupsV314Test-1440632162 None] Group tempest-GroupsV314Test-Group-1464468863: creating Sep 11 21:28:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5e223b0d-9adc-4d89-afdf-56e23e3a853d tempest-GroupsV314Test-1440632162 None] Group tempest-GroupsV314Test-Group-1464468863: created successfully Sep 11 21:28:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5e223b0d-9adc-4d89-afdf-56e23e3a853d tempest-GroupsV314Test-1440632162 None] Create group completed successfully. Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-909cbecd-1270-4ede-8035-368b628b9c21-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-909cbecd-1270-4ede-8035-368b628b9c21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-quobyte-909cbecd-1270-4ede-8035-368b628b9c21" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-909cbecd-1270-4ede-8035-368b628b9c21" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Deleting offline snapshot 909cbecd-1270-4ede-8035-368b628b9c21 of volume e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] snapshot_file for this snap is: volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5eaadf-fcf8-4e50-b3bc-9564a75b3639]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:43 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 Sep 11 21:28:43 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Flow 'volume_create_manager' (078f5dcf-0428-4f57-bef7-5821651158f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fc605c-98fa-482b-af94-6f3074e4e979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fc605c-98fa-482b-af94-6f3074e4e979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360483263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a064af2c-874f-4685-b1af-dde05c685573,host='devstack@QuobyteHD#QuobyteHD',id=f8d82b93-4b9c-466f-9ea4-8669e1e0c754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c94fe19b784542a18a4cc6f9ed2907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:44Z,use_quota=True,user_id='b81f18cded5346b0bb56f55605ee0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(061d9883-c85a-4a70-bfd8-fa9f2e364899),volume_type_id=061d9883-c85a-4a70-bfd8-fa9f2e364899)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c7d69a-dc99-446d-970b-4ba29c27c2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c7d69a-dc99-446d-970b-4ba29c27c2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb643c0-34c5-4c5d-9fcb-52eef0b953c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb643c0-34c5-4c5d-9fcb-52eef0b953c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d82b93-4b9c-466f-9ea4-8669e1e0c754', 'volume_name': 'volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d16520-1ea0-4855-b68d-1affce8abbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d16520-1ea0-4855-b68d-1affce8abbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1543ebc-cb40-473e-9471-ca30af26888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:44 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Volume f8d82b93-4b9c-466f-9ea4-8669e1e0c754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754', 'volume_size': 1} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a064af2c-874f-4685-b1af-dde05c685573,created_at=2026-09-11T19:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360483263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a064af2c-874f-4685-b1af-dde05c685573,host='devstack@QuobyteHD#QuobyteHD',id=f8d82b93-4b9c-466f-9ea4-8669e1e0c754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c94fe19b784542a18a4cc6f9ed2907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:44Z,use_quota=True,user_id='b81f18cded5346b0bb56f55605ee0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(061d9883-c85a-4a70-bfd8-fa9f2e364899),volume_type_id=061d9883-c85a-4a70-bfd8-fa9f2e364899)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Creating volume f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:28:44 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:44 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 1073741824 Sep 11 21:28:44 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:44 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21" returned: 0 in 0.790s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa27201-c5c0-4f8d-b1a6-b332d9abc1cb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:44 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f Sep 11 21:28:44 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:45 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 1073741824" returned: 0 in 0.883s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:45 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" returned: 0 in 0.656s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:45 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 Sep 11 21:28:45 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:45 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 Sep 11 21:28:45 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:45 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754" returned: 0 in 0.378s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1543ebc-cb40-473e-9471-ca30af26888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f35267-3da9-47c5-97f4-92c623903015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:45 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Volume volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 (f8d82b93-4b9c-466f-9ea4-8669e1e0c754): created successfully Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f35267-3da9-47c5-97f4-92c623903015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Flow 'volume_create_manager' (078f5dcf-0428-4f57-bef7-5821651158f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:45 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-588f7667-4587-4496-b8a6-4d4a6b17b9e2 tempest-GroupsV314Test-1440632162 None] Created volume successfully. Sep 11 21:28:45 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21" returned: 0 in 0.690s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:45 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21 Sep 11 21:28:45 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:46 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.909cbecd-1270-4ede-8035-368b628b9c21" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-909cbecd-1270-4ede-8035-368b628b9c21" released by "_delete_snapshot" :: held 2.668s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" released by "delete_snapshot" :: held 2.739s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Created reservations ['2fdc42b8-0120-48c9-ba2c-4bdce3b21660', 'e07dc341-08a7-4efd-8a70-ddb6d25a8ec5', '4cf002fe-44d2-4b8e-a383-76fe2f6bbefe', 'd51e4458-a750-487b-bfd1-f2879080e7ea'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Delete snapshot completed successfully. Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e00c2bf-321b-4d4f-9917-d5f5d5be637d tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-909cbecd-1270-4ede-8035-368b628b9c21-delete_snapshot" released by "delete_snapshot" :: held 2.963s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-c07bb171-0cf3-4eeb-8d88-40d09c6ef67f-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-c07bb171-0cf3-4eeb-8d88-40d09c6ef67f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-quobyte-c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Deleting offline snapshot c07bb171-0cf3-4eeb-8d88-40d09c6ef67f of volume e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] snapshot_file for this snap is: volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cecde3a-7f1e-4928-820e-d5bbd574ee17]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:47 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f Sep 11 21:28:47 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:47 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" returned: 0 in 0.547s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:28:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc0218-4fd5-4d80-a5c6-4452aba24cc6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:47 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Cloning volume f8d82b93-4b9c-466f-9ea4-8669e1e0c754 to volume bb3b953d-e3a0-49f1-9d00-1588ef9af643 Sep 11 21:28:47 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 Sep 11 21:28:47 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Creating offline snapshot 169085ca-a650-45dc-8673-83c68b37afd9 of volume f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:28:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07e507c-ac25-4026-8abc-c2d6dd355233]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:47 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 Sep 11 21:28:47 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:48 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" returned: 0 in 0.547s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:48 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f Sep 11 21:28:48 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:48 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754" returned: 0 in 0.582s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:48 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 1G Sep 11 21:28:48 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:48 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" returned: 0 in 0.490s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:48 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f Sep 11 21:28:48 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:48 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 1G" returned: 0 in 0.481s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:48 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 Sep 11 21:28:48 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:48 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" returned: 0 in 0.409s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-c07bb171-0cf3-4eeb-8d88-40d09c6ef67f" released by "_delete_snapshot" :: held 2.145s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" released by "delete_snapshot" :: held 2.186s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:49 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Created reservations ['e2aa84c6-e62c-4dce-9cbe-2d7b559a7d3b', 'b4821146-28d0-4aed-885b-c6f02876b796', '8cdd3a1f-c19f-4d7b-be8a-767e859eddd0', '8ec989a6-f8f5-45ed-8915-25d43db7b268'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Delete snapshot completed successfully. Sep 11 21:28:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c446aedd-8042-4967-bd87-f1788cc4e393 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-c07bb171-0cf3-4eeb-8d88-40d09c6ef67f-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:49 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9" returned: 0 in 0.405s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:49 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:28:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:49 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 Sep 11 21:28:49 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:49 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9" returned: 0 in 0.338s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:49 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.info Sep 11 21:28:49 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:49 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.info" returned: 0 in 0.254s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:49 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:28:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:49 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.info Sep 11 21:28:49 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-6b8c2a1e-7f96-409b-9fe2-f5e2d341c908-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-6b8c2a1e-7f96-409b-9fe2-f5e2d341c908-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-quobyte-6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Deleting offline snapshot 6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 of volume e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] snapshot_file for this snap is: volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:28:50 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.info" returned: 0 in 0.367s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Acquiring lock "cinder-quobyte-bb3b953d-e3a0-49f1-9d00-1588ef9af643" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f666fb0e-b37c-4f96-8a6a-85221ed5aadb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Lock "cinder-quobyte-bb3b953d-e3a0-49f1-9d00-1588ef9af643" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] snapshot: 169085ca-a650-45dc-8673-83c68b37afd9, volume: bb3b953d-e3a0-49f1-9d00-1588ef9af643, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7096c6-1743-42e1-8ce7-4a334d942906]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:50 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 Sep 11 21:28:50 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:50 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 Sep 11 21:28:50 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:50 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" returned: 0 in 0.498s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[42280275-adab-4d78-bcbf-cfd85bceecba]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:50 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9" returned: 0 in 0.616s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2c7329-b067-4d67-9aa9-747d919521c5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:50 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 Sep 11 21:28:50 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Flow 'volume_create_manager' (9c386f17-de4b-42e7-b8e5-3afaebf52fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61211da0-e7c2-46f2-bf72-fe8335c10846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61211da0-e7c2-46f2-bf72-fe8335c10846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1093515242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44daa727-8937-4690-bccb-ed3f61ccb26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8352382acf54daab34a8b5fbbcff37e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:51Z,use_quota=True,user_id='70cb4c8fdf3e4a48bae722bf72efc557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22467778-0580-4b17-ad4d-04e0d3fe5e50),volume_type_id=22467778-0580-4b17-ad4d-04e0d3fe5e50)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a201618f-4863-4a63-bc47-d25934195d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:51 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 Sep 11 21:28:51 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a201618f-4863-4a63-bc47-d25934195d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed6cf6b-03b3-4a25-947e-a7abd7c0a701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed6cf6b-03b3-4a25-947e-a7abd7c0a701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44daa727-8937-4690-bccb-ed3f61ccb26e', 'volume_name': 'volume-44daa727-8937-4690-bccb-ed3f61ccb26e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2204aa-b45b-4728-905d-1255e9f1f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2204aa-b45b-4728-905d-1255e9f1f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0171dd-3ee0-4dfb-8824-fe70c3867d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:51 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Volume 44daa727-8937-4690-bccb-ed3f61ccb26e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44daa727-8937-4690-bccb-ed3f61ccb26e', 'volume_size': 1} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:51 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" returned: 0 in 0.467s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:51 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 Sep 11 21:28:51 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:51 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754" returned: 0 in 0.451s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:51 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 Sep 11 21:28:51 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:51 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" returned: 0 in 0.341s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:51 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908 Sep 11 21:28:51 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:51 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17.6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" returned: 0 in 0.328s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-6b8c2a1e-7f96-409b-9fe2-f5e2d341c908" released by "_delete_snapshot" :: held 1.899s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" released by "delete_snapshot" :: held 1.952s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:52 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Created reservations ['1afafad0-f0d5-4901-a6b9-2aad6c8603c9', '4d76a0a8-51d8-4397-b09e-bba05e231a2a', 'a5d5c494-81c8-47fc-9014-39127473c3d6', '55d35526-347f-4537-9c51-dad7d1848a98'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:52 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Delete snapshot completed successfully. Sep 11 21:28:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-21e1051e-d25e-4b02-8c0c-2c07e9fa8ef9 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-6b8c2a1e-7f96-409b-9fe2-f5e2d341c908-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:53 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=139,cinder:SELECT=131,cinder:INSERT=34,cinder:DELETE=13 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:28:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:54 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[61479606-754d-44d8-8618-33818effa408]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:54 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 Sep 11 21:28:54 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:55 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" returned: 0 in 1.197s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:55 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17 Sep 11 21:28:55 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:55 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" returned: 0 in 0.496s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-quobyte-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17" released by "delete_volume" :: held 1.880s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:55 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Created reservations ['3390e660-00e2-498f-b79e-88c0fea85fd9', '103ea193-3adc-4162-b5cd-4630016828e9', '2f34ca33-c3bb-426a-b306-1684fc1d5cdb', '26dcfbb1-5be6-4bdc-8fd3-84354ac40840'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:56 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:28:56 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:56 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.661s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:28:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Deleted volume successfully. Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bec450b0-f7f5-40dc-b376-5b01ae19bbb2 tempest-VolumesSnapshotListTestJSON-957035900 None] Lock "cinder-e27a2d70-e6b5-45b0-aa04-1c5d5be89d17-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:56 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643" returned: 0 in 5.465s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:28:56 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Converted 1024.00 MB image at 187.34 MB/s Sep 11 21:28:56 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:28:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:56 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 Sep 11 21:28:56 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:57 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643" returned: 0 in 0.261s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Lock "cinder-quobyte-bb3b953d-e3a0-49f1-9d00-1588ef9af643" released by "_copy_volume_from_snapshot" :: held 6.870s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Acquiring lock "cinder-quobyte-169085ca-a650-45dc-8673-83c68b37afd9" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Lock "cinder-quobyte-169085ca-a650-45dc-8673-83c68b37afd9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Deleting offline snapshot 169085ca-a650-45dc-8673-83c68b37afd9 of volume f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] snapshot_file for this snap is: volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c3745c-2099-4c6e-a4a7-a35c7acca763]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:57 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 Sep 11 21:28:57 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:57 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9" returned: 0 in 0.354s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3acf7cf-cccf-4def-9e9d-e40f72273faf]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:28:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:57 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 Sep 11 21:28:57 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:58 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754" returned: 0 in 0.582s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:58 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 Sep 11 21:28:58 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:58 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9" returned: 0 in 0.366s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:58 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9 Sep 11 21:28:58 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:58 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754.169085ca-a650-45dc-8673-83c68b37afd9" returned: 0 in 0.255s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Lock "cinder-quobyte-169085ca-a650-45dc-8673-83c68b37afd9" released by "_delete_snapshot" :: held 1.657s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=123,cinder:INSERT=46,cinder:UPDATE=149,cinder:DELETE=9 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.259s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.705s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1093515242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44daa727-8937-4690-bccb-ed3f61ccb26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8352382acf54daab34a8b5fbbcff37e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:28:51Z,use_quota=True,user_id='70cb4c8fdf3e4a48bae722bf72efc557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22467778-0580-4b17-ad4d-04e0d3fe5e50),volume_type_id=22467778-0580-4b17-ad4d-04e0d3fe5e50)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Creating volume 44daa727-8937-4690-bccb-ed3f61ccb26e {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:28:58 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:28:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:58 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e 1073741824 Sep 11 21:28:58 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fb992487-1439-42cf-892d-2c1fa715ec0c tempest-GroupsV314Test-1440632162 None] Create group from source-group-a064af2c-874f-4685-b1af-dde05c685573 completed successfully. Sep 11 21:28:59 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e 1073741824" returned: 0 in 0.436s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:28:59 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e Sep 11 21:28:59 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:28:59 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 11 21:28:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e" returned: 0 in 0.269s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:28:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:28:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:28:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0171dd-3ee0-4dfb-8824-fe70c3867d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44daa727-8937-4690-bccb-ed3f61ccb26e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cc4615-7ab1-46e0-ab02-191d35ef6f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:28:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Volume volume-44daa727-8937-4690-bccb-ed3f61ccb26e (44daa727-8937-4690-bccb-ed3f61ccb26e): created successfully Sep 11 21:28:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cc4615-7ab1-46e0-ab02-191d35ef6f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:28:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Flow 'volume_create_manager' (9c386f17-de4b-42e7-b8e5-3afaebf52fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:28:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-02f7322a-fb47-434f-82e4-af86f3333a16 tempest-VolumeTypesAccessTest-1974551432 None] Created volume successfully. Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Acquiring lock "cinder-quobyte-bb3b953d-e3a0-49f1-9d00-1588ef9af643" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Lock "cinder-quobyte-bb3b953d-e3a0-49f1-9d00-1588ef9af643" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20f2b5c-678a-4e70-8719-76a615235c45]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Acquiring lock "cinder-44daa727-8937-4690-bccb-ed3f61ccb26e-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Lock "cinder-44daa727-8937-4690-bccb-ed3f61ccb26e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:00 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 Sep 11 21:29:00 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Acquiring lock "cinder-quobyte-44daa727-8937-4690-bccb-ed3f61ccb26e" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Lock "cinder-quobyte-44daa727-8937-4690-bccb-ed3f61ccb26e" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09f428f-37de-4b99-8d06-7cd67b56b349]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:00 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e Sep 11 21:29:00 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:00 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643" returned: 0 in 0.456s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:00 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643 Sep 11 21:29:00 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:00 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e" returned: 0 in 0.400s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:00 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e Sep 11 21:29:00 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:00 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb3b953d-e3a0-49f1-9d00-1588ef9af643" returned: 0 in 0.298s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Lock "cinder-quobyte-bb3b953d-e3a0-49f1-9d00-1588ef9af643" released by "delete_volume" :: held 0.815s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Flow 'volume_create_manager' (b62ab3c0-49a9-4a7c-9dca-acebec816e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8dcbf0-0ba6-45ba-9e5a-ebb197e61ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8dcbf0-0ba6-45ba-9e5a-ebb197e61ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1464506499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c757c305-297f-4eb3-a13f-1526714444d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6092ba20aa4328be6f7da7153a7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:01Z,use_quota=True,user_id='221b603476dc4a6a8415e8b2c5e37047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48eb432-9938-4f3c-b2bd-9aa54c15198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:01 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48eb432-9938-4f3c-b2bd-9aa54c15198d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c95c0af-e243-4f68-9110-4d0a857a880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c95c0af-e243-4f68-9110-4d0a857a880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c757c305-297f-4eb3-a13f-1526714444d2', 'volume_name': 'volume-c757c305-297f-4eb3-a13f-1526714444d2', 'volume_size': 2}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c870edfb-19ee-40de-8977-4617637af17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c870edfb-19ee-40de-8977-4617637af17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f837f4e-6319-44ac-8c1a-fb77892288e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:01 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Volume c757c305-297f-4eb3-a13f-1526714444d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c757c305-297f-4eb3-a13f-1526714444d2', 'volume_size': 2} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1464506499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c757c305-297f-4eb3-a13f-1526714444d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6092ba20aa4328be6f7da7153a7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:01Z,use_quota=True,user_id='221b603476dc4a6a8415e8b2c5e37047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Creating volume c757c305-297f-4eb3-a13f-1526714444d2 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:29:01 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 2147483648 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Created reservations ['5ffc5389-3053-400c-a445-8d53fafd9f52'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-44daa727-8937-4690-bccb-ed3f61ccb26e" returned: 0 in 0.341s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:01 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 2147483648 Sep 11 21:29:01 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Lock "cinder-quobyte-44daa727-8937-4690-bccb-ed3f61ccb26e" released by "delete_volume" :: held 0.800s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:01 devstack cinder-volume[87423]: WARNING cinder.quota [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1060042770 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1060042770, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:29:01 devstack cinder-volume[87423]: WARNING cinder.quota [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1060042770 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1060042770, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:29:01 devstack cinder-volume[87423]: WARNING cinder.quota [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2089252781 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2089252781, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:29:01 devstack cinder-volume[87423]: WARNING cinder.quota [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2089252781 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2089252781, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Created reservations ['7538d086-4bce-444f-9467-83800e15e272', '32fde772-dda4-4f0d-9d85-2e0a4c4852f5', '74b0e65a-0fb0-4518-8da1-27780ccacf52', '08e6d251-1207-4f00-a3f5-2df1cf73125b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Created reservations ['cb38facb-76d0-4089-9eb1-072806dd663f', '6d7b80f8-7552-4ae5-947f-b1e1a7fc3293', 'b5f721f1-d730-48b7-a140-c89aac63ccb6', 'e1fbd6b0-de4a-43f6-90f9-bdad2f7a6a4a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:01 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:01 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:01 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:01 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:01 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.328s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Deleted volume successfully. Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-da7ed57a-a8de-4927-bfae-cac17b1405f2 tempest-VolumeTypesAccessTest-1974551432 None] Lock "cinder-44daa727-8937-4690-bccb-ed3f61ccb26e-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:01 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.331s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e5923a93-c5b6-466d-a8c5-c88440ce0729 tempest-GroupsV314Test-1440632162 None] Delete group completed successfully. Sep 11 21:29:01 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 2147483648" returned: 0 in 0.773s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:01 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 Sep 11 21:29:01 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:02 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2" returned: 0 in 0.286s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f837f4e-6319-44ac-8c1a-fb77892288e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c757c305-297f-4eb3-a13f-1526714444d2', 'volume_size': 2}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ffe886-4ce5-406f-806d-aa0f01dae05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:02 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Volume volume-c757c305-297f-4eb3-a13f-1526714444d2 (c757c305-297f-4eb3-a13f-1526714444d2): created successfully Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ffe886-4ce5-406f-806d-aa0f01dae05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Flow 'volume_create_manager' (b62ab3c0-49a9-4a7c-9dca-acebec816e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:02 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ed1ad16e-28fd-42a5-b898-88f1a868fdd8 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Created volume successfully. Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Acquiring lock "cinder-quobyte-f8d82b93-4b9c-466f-9ea4-8669e1e0c754" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Lock "cinder-quobyte-f8d82b93-4b9c-466f-9ea4-8669e1e0c754" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[59790ecb-41e8-4551-b560-d13888e6c6e3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:02 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 Sep 11 21:29:02 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:03 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754" returned: 0 in 0.460s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:03 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754 Sep 11 21:29:03 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Creating offline snapshot 1f56853b-f89d-43cb-b411-c546f3f0d547 of volume c757c305-297f-4eb3-a13f-1526714444d2 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae50304-d228-4780-bfce-026779ae5db2]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:03 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 Sep 11 21:29:03 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:03 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f8d82b93-4b9c-466f-9ea4-8669e1e0c754" returned: 0 in 0.373s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Lock "cinder-quobyte-f8d82b93-4b9c-466f-9ea4-8669e1e0c754" released by "delete_volume" :: held 0.906s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Created reservations ['0bd9eb05-76c5-4b32-92cc-5dc5e5e7ddae'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Created reservations ['ef5b993d-69be-4c2e-a3ae-db0f89123c75', '2ed2d424-b3e6-4b06-b4a8-f64a41dc9297', 'be0b5105-b7f7-445c-98ec-20f0fb7fb7ce', '43865b20-a47d-42eb-b5f7-ecf18c5d7ae6'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:03 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2" returned: 0 in 0.481s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 2G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:03 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 2G Sep 11 21:29:03 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:03 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:03 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:04 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.304s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:04 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8cdaf834-6593-49ee-a3d9-aac092e5ea7d tempest-GroupsV314Test-1440632162 None] Delete group completed successfully. Sep 11 21:29:04 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 2G" returned: 0 in 0.569s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c757c305-297f-4eb3-a13f-1526714444d2 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:04 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c757c305-297f-4eb3-a13f-1526714444d2 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 Sep 11 21:29:04 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:04 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c757c305-297f-4eb3-a13f-1526714444d2 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547" returned: 0 in 0.417s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:04 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 is being set with open permissions: ugo+rw Sep 11 21:29:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:04 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 Sep 11 21:29:04 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:05 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547" returned: 0 in 0.369s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:05 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.info Sep 11 21:29:05 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:05 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.info" returned: 0 in 0.419s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:05 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.info is being set with open permissions: ugo+rw Sep 11 21:29:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:05 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.info Sep 11 21:29:05 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:06 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.info" returned: 0 in 0.369s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.754s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-34cb5b47-05d9-4c49-8e31-bd54b913d186 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Create snapshot completed successfully Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Acquiring lock "cinder-1f56853b-f89d-43cb-b411-c546f3f0d547-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-1f56853b-f89d-43cb-b411-c546f3f0d547-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Acquiring lock "cinder-quobyte-c757c305-297f-4eb3-a13f-1526714444d2" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-quobyte-c757c305-297f-4eb3-a13f-1526714444d2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Acquiring lock "cinder-quobyte-1f56853b-f89d-43cb-b411-c546f3f0d547" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-quobyte-1f56853b-f89d-43cb-b411-c546f3f0d547" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Deleting offline snapshot 1f56853b-f89d-43cb-b411-c546f3f0d547 of volume c757c305-297f-4eb3-a13f-1526714444d2 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] snapshot_file for this snap is: volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8d8e84-48b9-4172-99a2-b743a92dec53]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:06 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 Sep 11 21:29:06 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:07 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547" returned: 0 in 0.392s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c757c305-297f-4eb3-a13f-1526714444d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:29:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5336ebfa-bf39-48eb-8f0e-247204d34597]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:07 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 Sep 11 21:29:07 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:07 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2" returned: 0 in 0.423s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:07 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 Sep 11 21:29:07 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:08 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547" returned: 0 in 0.614s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:08 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547 Sep 11 21:29:08 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:08 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2.1f56853b-f89d-43cb-b411-c546f3f0d547" returned: 0 in 0.351s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-quobyte-1f56853b-f89d-43cb-b411-c546f3f0d547" released by "_delete_snapshot" :: held 1.924s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-quobyte-c757c305-297f-4eb3-a13f-1526714444d2" released by "delete_snapshot" :: held 1.963s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:08 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Created reservations ['0a3cdb4d-9838-45e1-a961-990029d89d20', 'be04ee92-98ee-4579-a3ad-003a9804bdb1', '5f238d11-c24a-48ae-8fc0-36127ef7d8e6', 'd194ee9a-e4a1-4706-9bb0-1d66093e71f6'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:08 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Delete snapshot completed successfully. Sep 11 21:29:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-87b19860-fccc-489f-806f-2fb7a5895f29 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-1f56853b-f89d-43cb-b411-c546f3f0d547-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Acquiring lock "cinder-c757c305-297f-4eb3-a13f-1526714444d2-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-c757c305-297f-4eb3-a13f-1526714444d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Acquiring lock "cinder-quobyte-c757c305-297f-4eb3-a13f-1526714444d2" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-quobyte-c757c305-297f-4eb3-a13f-1526714444d2" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2de2b54-a4c6-4c45-ac7d-d2e867cc099d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:10 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 Sep 11 21:29:10 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:10 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2" returned: 0 in 0.533s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:10 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2 Sep 11 21:29:10 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:11 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c757c305-297f-4eb3-a13f-1526714444d2" returned: 0 in 0.351s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-quobyte-c757c305-297f-4eb3-a13f-1526714444d2" released by "delete_volume" :: held 0.975s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Created reservations ['4d13c150-4731-44ef-93f1-057f55241b67', '56fcc3e1-7af8-4500-8cb9-ebdfa0d76043', '6bea6319-7b7a-47a0-b07b-c86dad3cc420', '0f268bc4-7ae4-4ab2-adfc-d4c16cba4c32'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-362f4689-ef1b-4544-b978-5d2185b01302 req-7b8d400b-2dc5-47cc-a8cf-bef66ff82424 tempest-AttachVolumeNegativeTest-717306620 None] Terminate volume connection completed successfully. Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-362f4689-ef1b-4544-b978-5d2185b01302 req-7b8d400b-2dc5-47cc-a8cf-bef66ff82424 tempest-AttachVolumeNegativeTest-717306620 None] Deleting attachment 344fef3a-9ce1-493b-bde6-7674fa41fa86. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:11 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:11 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:11 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.289s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Deleted volume successfully. Sep 11 21:29:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8157f957-1fd6-433d-85bd-d841277f0a80 tempest-VolumesSnapshotNegativeTestJSON-1999707793 None] Lock "cinder-c757c305-297f-4eb3-a13f-1526714444d2-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:29:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:15 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:15 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:16 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.488s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:29:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 28 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:29:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:29:21 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=52,cinder:INSERT=16,cinder:UPDATE=63,cinder:DELETE=2 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:29:21 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=51,cinder:SELECT=37,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Flow 'volume_create_manager' (2e514fe2-8843-4a6a-98f1-41d0df145798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad759e19-affd-4575-9d8f-1c91120c2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad759e19-affd-4575-9d8f-1c91120c2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1110199740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a98f33b-f5b0-494d-8fad-54f4b8d8555b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb5463dcd56413db16a51da3c6ce469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:28Z,use_quota=True,user_id='d370a49cf8664d0c974f6316eda13c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f42087-a03c-41c7-bae9-3b9f443b4c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f42087-a03c-41c7-bae9-3b9f443b4c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254fa570-0691-4442-a72c-4372b7b130e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254fa570-0691-4442-a72c-4372b7b130e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a98f33b-f5b0-494d-8fad-54f4b8d8555b', 'volume_name': 'volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20dc8051-8bc6-41e1-98b4-2b5301740193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20dc8051-8bc6-41e1-98b4-2b5301740193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b75ab4-318c-4afb-ba07-f52389ed1004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:28 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Volume 3a98f33b-f5b0-494d-8fad-54f4b8d8555b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b', 'volume_size': 1} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1110199740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a98f33b-f5b0-494d-8fad-54f4b8d8555b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb5463dcd56413db16a51da3c6ce469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:28Z,use_quota=True,user_id='d370a49cf8664d0c974f6316eda13c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Creating volume 3a98f33b-f5b0-494d-8fad-54f4b8d8555b {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:29:28 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:29:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:28 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b 1073741824 Sep 11 21:29:28 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:29 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b 1073741824" returned: 0 in 0.667s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:29 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b Sep 11 21:29:29 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Flow 'volume_create_manager' (67ccb194-5492-422d-b6cf-5572bce07248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af587ee-3290-40ca-b84d-3d84ad29aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af587ee-3290-40ca-b84d-3d84ad29aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-895679784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce196a9a1a3940e0bcadaa14b71d199c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:29Z,use_quota=True,user_id='0e2cfe3f2c024a54a465399b1278da57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f34e4c8-2861-4ea9-9869-5ba46a6b56ff),volume_type_id=0f34e4c8-2861-4ea9-9869-5ba46a6b56ff)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096f05b3-bd7e-432a-85a1-a95a9356888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096f05b3-bd7e-432a-85a1-a95a9356888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f46fdc-c78c-4b36-9380-897649b50746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f46fdc-c78c-4b36-9380-897649b50746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44', 'volume_name': 'volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788e7170-be6c-437a-abfd-cad079f58b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788e7170-be6c-437a-abfd-cad079f58b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453cdc83-ddd6-462b-b47f-eefe6cd70a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:29 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Volume a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44', 'volume_size': 1} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:29 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b" returned: 0 in 0.365s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.077s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-895679784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce196a9a1a3940e0bcadaa14b71d199c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:29Z,use_quota=True,user_id='0e2cfe3f2c024a54a465399b1278da57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f34e4c8-2861-4ea9-9869-5ba46a6b56ff),volume_type_id=0f34e4c8-2861-4ea9-9869-5ba46a6b56ff)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Creating volume a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:29:29 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b75ab4-318c-4afb-ba07-f52389ed1004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:29 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 1073741824 Sep 11 21:29:29 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf427e28-46aa-4f2a-b1ca-f1f37e63c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:29 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Volume volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b (3a98f33b-f5b0-494d-8fad-54f4b8d8555b): created successfully Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf427e28-46aa-4f2a-b1ca-f1f37e63c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Flow 'volume_create_manager' (2e514fe2-8843-4a6a-98f1-41d0df145798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:29 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-39e20e48-3011-4bfe-a564-d1a95665223d tempest-VolumesMetadataTest-620074023 None] Created volume successfully. Sep 11 21:29:30 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 1073741824" returned: 0 in 0.624s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:30 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 Sep 11 21:29:30 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:30 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44" returned: 0 in 0.317s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:29:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453cdc83-ddd6-462b-b47f-eefe6cd70a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c50fe98-9812-408e-97cc-8c54c61a1a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:30 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Volume volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 (a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44): created successfully Sep 11 21:29:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c50fe98-9812-408e-97cc-8c54c61a1a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Flow 'volume_create_manager' (67ccb194-5492-422d-b6cf-5572bce07248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:30 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-eccb9cc6-8d65-4c67-9152-82dd2116b924 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Created volume successfully. Sep 11 21:29:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-151859ef-f730-454d-87ac-27cda0d743c5 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-151859ef-f730-454d-87ac-27cda0d743c5 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-151859ef-f730-454d-87ac-27cda0d743c5 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-151859ef-f730-454d-87ac-27cda0d743c5 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-151859ef-f730-454d-87ac-27cda0d743c5 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-151859ef-f730-454d-87ac-27cda0d743c5 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:31 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:31 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Acquiring lock "cinder-3a98f33b-f5b0-494d-8fad-54f4b8d8555b-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Lock "cinder-3a98f33b-f5b0-494d-8fad-54f4b8d8555b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Acquiring lock "cinder-quobyte-3a98f33b-f5b0-494d-8fad-54f4b8d8555b" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Lock "cinder-quobyte-3a98f33b-f5b0-494d-8fad-54f4b8d8555b" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ba0a0d-5bc9-4397-b359-f96003f6f505]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:32 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-151859ef-f730-454d-87ac-27cda0d743c5 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.541s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-151859ef-f730-454d-87ac-27cda0d743c5 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:32 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b Sep 11 21:29:32 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:32 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-151859ef-f730-454d-87ac-27cda0d743c5 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Retype volume completed successfully. Sep 11 21:29:32 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b" returned: 0 in 0.617s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:33 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b Sep 11 21:29:33 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Acquiring lock "cinder-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "cinder-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:33 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-3a98f33b-f5b0-494d-8fad-54f4b8d8555b" returned: 0 in 0.498s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Lock "cinder-quobyte-3a98f33b-f5b0-494d-8fad-54f4b8d8555b" released by "delete_volume" :: held 1.209s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Acquiring lock "cinder-quobyte-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "cinder-quobyte-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44" acquired by "delete_volume" :: waited 0.044s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f7b457-9a19-4a2d-a62a-9d7b2e196eac]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Created reservations ['5e314a11-6443-46d1-964c-e6e5eb3de220', '2b68c54f-cc0c-46d2-9ccc-9ee521294934', 'a8973ef3-849e-4dc8-bb2a-014409e1638d', '43b6b45a-3060-4767-9299-06a01a43e2b5'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:33 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 Sep 11 21:29:33 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:33 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:33 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:34 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.593s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:34 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Deleted volume successfully. Sep 11 21:29:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d58369a-3eb2-47fd-a738-c875d1c612a8 tempest-VolumesMetadataTest-620074023 None] Lock "cinder-3a98f33b-f5b0-494d-8fad-54f4b8d8555b-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:34 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44" returned: 0 in 0.853s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:34 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44 Sep 11 21:29:34 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:34 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44" returned: 0 in 0.329s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "cinder-quobyte-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44" released by "delete_volume" :: held 1.270s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:34 devstack cinder-volume[87423]: WARNING cinder.quota [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:29:34 devstack cinder-volume[87423]: WARNING cinder.quota [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:29:34 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Created reservations ['e6731a1e-baf9-4315-9e90-2f999d03984b', 'c79f08ac-83a8-4dc6-8ff5-80e0a1c6869d', '663bf4c9-ecb6-499d-a438-9bfdaed4d81a', '06043348-d19f-4d55-b6d3-d47f5aa7edfe'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:35 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:35 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:35 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.389s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:35 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:35 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Deleted volume successfully. Sep 11 21:29:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-71ed2fbd-9f59-48af-b5c4-8b1c23ed2237 tempest-VolumeRetypeWithoutMigrationTest-981220549 None] Lock "cinder-a933e5ba-c49c-49cd-a7e4-a86e0cbbcc44-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Flow 'volume_create_manager' (b799c01f-1516-46bc-a402-f27ff9165c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357a0c45-435c-474c-b131-2ebc959385af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357a0c45-435c-474c-b131-2ebc959385af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-645706805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437d3096-a120-4c46-b730-29da59e316b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ffb506a26741989225885109a640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:43Z,use_quota=True,user_id='33c8369f188245b3a88b111677071fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56cb0dc2-4fee-40ce-a4bb-9dde9dd77b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56cb0dc2-4fee-40ce-a4bb-9dde9dd77b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea9e028-4cb8-45c4-bdd1-d1c642a37cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea9e028-4cb8-45c4-bdd1-d1c642a37cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437d3096-a120-4c46-b730-29da59e316b6', 'volume_name': 'volume-437d3096-a120-4c46-b730-29da59e316b6', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da708ca-08f0-4688-b22d-8d941e11f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da708ca-08f0-4688-b22d-8d941e11f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dcc6e4-95b0-4bf1-9f99-82f87a465b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:43 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Volume 437d3096-a120-4c46-b730-29da59e316b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437d3096-a120-4c46-b730-29da59e316b6', 'volume_size': 1} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-645706805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437d3096-a120-4c46-b730-29da59e316b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ffb506a26741989225885109a640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:43Z,use_quota=True,user_id='33c8369f188245b3a88b111677071fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Creating volume 437d3096-a120-4c46-b730-29da59e316b6 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:29:43 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:29:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:43 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6 1073741824 Sep 11 21:29:43 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:44 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6 1073741824" returned: 0 in 0.792s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:44 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6 Sep 11 21:29:44 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:44 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6" returned: 0 in 0.470s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:29:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dcc6e4-95b0-4bf1-9f99-82f87a465b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437d3096-a120-4c46-b730-29da59e316b6', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec6e904-91c1-4162-96e7-f4b28ae93f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:44 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Volume volume-437d3096-a120-4c46-b730-29da59e316b6 (437d3096-a120-4c46-b730-29da59e316b6): created successfully Sep 11 21:29:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec6e904-91c1-4162-96e7-f4b28ae93f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Flow 'volume_create_manager' (b799c01f-1516-46bc-a402-f27ff9165c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-47e265d1-3da1-420e-95f0-0762f6ed251a tempest-VolumesTransfersV355Test-519787951 None] Created volume successfully. Sep 11 21:29:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ad3b2eef-c5ce-4da5-b690-6644908b9d8a tempest-VolumesTransfersV355Test-2142254877 None] Transfer volume completed successfully. Sep 11 21:29:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Acquiring lock "cinder-437d3096-a120-4c46-b730-29da59e316b6-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Lock "cinder-437d3096-a120-4c46-b730-29da59e316b6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Acquiring lock "cinder-quobyte-437d3096-a120-4c46-b730-29da59e316b6" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Lock "cinder-quobyte-437d3096-a120-4c46-b730-29da59e316b6" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f82dc0-1458-4f1e-90bc-ca7f1a9f1859]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:47 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6 Sep 11 21:29:47 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:48 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6" returned: 0 in 0.396s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:48 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6 Sep 11 21:29:48 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:48 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-437d3096-a120-4c46-b730-29da59e316b6" returned: 0 in 0.303s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Lock "cinder-quobyte-437d3096-a120-4c46-b730-29da59e316b6" released by "delete_volume" :: held 0.764s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Created reservations ['36addb10-0fd5-456d-acd8-8f2b837557b2', '36c45411-4e76-408c-9c22-7e97500a4c2e', '95e5649e-ead3-4e45-95c3-26ea340c28db', 'ebe5d450-6fc3-4684-bc98-e91d169b81bd'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:48 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:48 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:48 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:48 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Deleted volume successfully. Sep 11 21:29:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-aa0f3c1d-4d15-4e20-87a5-236e6ffee537 tempest-VolumesTransfersV355Test-1710026290 None] Lock "cinder-437d3096-a120-4c46-b730-29da59e316b6-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Flow 'volume_create_manager' (92cd6794-6236-429e-be06-a806164fc0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a44f69b-5411-4f37-9132-4088a6e58fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a44f69b-5411-4f37-9132-4088a6e58fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-874070995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8501fd14-3b98-4b11-a61f-1d233cf358b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ffb506a26741989225885109a640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:49Z,use_quota=True,user_id='33c8369f188245b3a88b111677071fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85fdb8c-7c31-43fe-81d9-a22bce4d8790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85fdb8c-7c31-43fe-81d9-a22bce4d8790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547df0aa-c520-404d-816d-6a64d285a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547df0aa-c520-404d-816d-6a64d285a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8501fd14-3b98-4b11-a61f-1d233cf358b1', 'volume_name': 'volume-8501fd14-3b98-4b11-a61f-1d233cf358b1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699ae229-c4f0-4fe6-850d-fa10ada0958d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699ae229-c4f0-4fe6-850d-fa10ada0958d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab9efc4-f447-4873-a921-de20393f0071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:49 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Volume 8501fd14-3b98-4b11-a61f-1d233cf358b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8501fd14-3b98-4b11-a61f-1d233cf358b1', 'volume_size': 1} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-874070995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8501fd14-3b98-4b11-a61f-1d233cf358b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ffb506a26741989225885109a640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:49Z,use_quota=True,user_id='33c8369f188245b3a88b111677071fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Creating volume 8501fd14-3b98-4b11-a61f-1d233cf358b1 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:29:49 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:29:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:49 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 1073741824 Sep 11 21:29:49 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:50 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 1073741824" returned: 0 in 0.523s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:50 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 Sep 11 21:29:50 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:50 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1" returned: 0 in 0.301s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:29:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab9efc4-f447-4873-a921-de20393f0071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8501fd14-3b98-4b11-a61f-1d233cf358b1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e3829e-37d8-4932-ba38-028beaf873ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Volume volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 (8501fd14-3b98-4b11-a61f-1d233cf358b1): created successfully Sep 11 21:29:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e3829e-37d8-4932-ba38-028beaf873ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Flow 'volume_create_manager' (92cd6794-6236-429e-be06-a806164fc0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8065d9c0-2b19-4ad5-875a-da40fde2d7aa tempest-VolumesTransfersV355Test-519787951 None] Created volume successfully. Sep 11 21:29:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Acquiring lock "cinder-8501fd14-3b98-4b11-a61f-1d233cf358b1-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Lock "cinder-8501fd14-3b98-4b11-a61f-1d233cf358b1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Acquiring lock "cinder-quobyte-8501fd14-3b98-4b11-a61f-1d233cf358b1" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:29:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Lock "cinder-quobyte-8501fd14-3b98-4b11-a61f-1d233cf358b1" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:29:52 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea81e088-1cff-4a53-b5bf-9de6b115b9f1]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:52 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 Sep 11 21:29:52 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:52 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1" returned: 0 in 0.486s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:52 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1 Sep 11 21:29:52 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:52 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8501fd14-3b98-4b11-a61f-1d233cf358b1" returned: 0 in 0.379s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Lock "cinder-quobyte-8501fd14-3b98-4b11-a61f-1d233cf358b1" released by "delete_volume" :: held 0.936s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Created reservations ['0290ed7a-00d0-40c3-8ad1-adf9a16b5cd9', '615fe2e3-8bec-4c70-8fc2-232cd9123693', '1d0e4ef6-174e-412a-9ca5-114048c5bd0a', '977b6371-dea8-4431-9f61-bb7d6900ee4c'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:53 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:29:53 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:53 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.401s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:29:53 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Deleted volume successfully. Sep 11 21:29:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9b643c3-d0e1-49ee-bf6b-3168fa2b33f7 tempest-VolumesTransfersV355Test-1710026290 None] Lock "cinder-8501fd14-3b98-4b11-a61f-1d233cf358b1-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Flow 'volume_create_manager' (749ca6c6-5296-4d84-9e52-83353d2dec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ab6033-57a2-4b84-be96-a0ba78faf7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ab6033-57a2-4b84-be96-a0ba78faf7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-72281143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baad4c82f61843a68f45e01af608db60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:57Z,use_quota=True,user_id='149b48d64a1a417aad30a098282029b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5928cef2-7bed-4d82-8da4-a0a5794295b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5928cef2-7bed-4d82-8da4-a0a5794295b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e849c3bd-68ea-4dda-9251-26b2039edd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e849c3bd-68ea-4dda-9251-26b2039edd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd', 'volume_name': 'volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f778e7-0920-4bcd-9427-b9b960230c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f778e7-0920-4bcd-9427-b9b960230c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9192bb-3b7e-4e39-a90c-fc301522e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:56 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Volume 6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd', 'volume_size': 1} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-72281143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baad4c82f61843a68f45e01af608db60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:29:57Z,use_quota=True,user_id='149b48d64a1a417aad30a098282029b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Creating volume 6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:29:56 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:29:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:57 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd 1073741824 Sep 11 21:29:57 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:57 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd 1073741824" returned: 0 in 0.688s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:57 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd Sep 11 21:29:57 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:58 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" returned: 0 in 0.508s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:29:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:29:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9192bb-3b7e-4e39-a90c-fc301522e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218686c2-851c-4d9e-b509-6fac0789dd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:29:58 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Volume volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd (6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd): created successfully Sep 11 21:29:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218686c2-851c-4d9e-b509-6fac0789dd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:29:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Flow 'volume_create_manager' (749ca6c6-5296-4d84-9e52-83353d2dec43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:29:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-30ff7690-d12b-4133-8feb-1bc6984cbb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Created volume successfully. Sep 11 21:29:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:29:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:29:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Creating offline snapshot 097b9b50-6176-4d29-8326-82336e56103d of volume 6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:29:59 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d71a3-3980-43c2-907a-b3d324d9e6fd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:29:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:59 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd Sep 11 21:29:59 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:29:59 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 11 21:29:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" returned: 0 in 0.695s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:29:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:29:59 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d 1G Sep 11 21:29:59 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:00 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d 1G" returned: 0 in 0.948s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:00 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d Sep 11 21:30:00 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Flow 'volume_create_manager' (bd2abd25-a4af-4b0d-ab7d-1a6483c44280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef3cc54-7ef2-4e85-bebf-ab27bb973e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef3cc54-7ef2-4e85-bebf-ab27bb973e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1487390966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192e9453-3c73-4c89-9e7a-35f2c7a98733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e17b521db643249bf19c1ff277c77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:01Z,use_quota=True,user_id='291740fd7eba49a3bf4ef155f69c8a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44459af5-6faa-4d31-9c19-1439db2f7f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44459af5-6faa-4d31-9c19-1439db2f7f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce79037b-c6d6-4d57-b1bc-3877370a3eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce79037b-c6d6-4d57-b1bc-3877370a3eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192e9453-3c73-4c89-9e7a-35f2c7a98733', 'volume_name': 'volume-192e9453-3c73-4c89-9e7a-35f2c7a98733', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b72aa67-4007-46fd-8b27-c5664cd2d5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b72aa67-4007-46fd-8b27-c5664cd2d5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad117111-b953-406d-b3ab-aab17047e21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Volume 192e9453-3c73-4c89-9e7a-35f2c7a98733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192e9453-3c73-4c89-9e7a-35f2c7a98733', 'volume_size': 1} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:01 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d" returned: 0 in 0.544s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:01 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d is being set with open permissions: ugo+rw Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:01 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d Sep 11 21:30:01 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Flow 'volume_create_manager' (d2901bfe-0759-424c-856a-9969b7438a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988625f5-9001-4e09-8239-fdf7ab8e1c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988625f5-9001-4e09-8239-fdf7ab8e1c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2008791942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e450d428-94db-4df1-bca8-4f8e105c2afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1429a7e0aa6d468d836e92a30bac234c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:01Z,use_quota=True,user_id='065aaea607b948f69d86fc0af1f80ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45fa87b-783b-4dbb-ba7f-7d486ddc2627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45fa87b-783b-4dbb-ba7f-7d486ddc2627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d66d4d1-15bb-4e27-aa87-48007a560e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d66d4d1-15bb-4e27-aa87-48007a560e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e450d428-94db-4df1-bca8-4f8e105c2afc', 'volume_name': 'volume-e450d428-94db-4df1-bca8-4f8e105c2afc', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9855ed2-51fa-4472-858d-fb0c8841179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9855ed2-51fa-4472-858d-fb0c8841179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5add77aa-7937-489c-9126-120ced68d8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:01 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Volume e450d428-94db-4df1-bca8-4f8e105c2afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e450d428-94db-4df1-bca8-4f8e105c2afc', 'volume_size': 1} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:01 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d" returned: 0 in 0.344s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:01 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.info Sep 11 21:30:01 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:02 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.info" returned: 0 in 0.280s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:02 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.info is being set with open permissions: ugo+rw Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:02 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.info Sep 11 21:30:02 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:02 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.info" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.231s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1487390966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192e9453-3c73-4c89-9e7a-35f2c7a98733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e17b521db643249bf19c1ff277c77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:01Z,use_quota=True,user_id='291740fd7eba49a3bf4ef155f69c8a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Creating volume 192e9453-3c73-4c89-9e7a-35f2c7a98733 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:02 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:02 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 1073741824 Sep 11 21:30:02 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:02 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-44f1d8b5-b0ae-4f63-b1b9-f30b726fe5ee tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Create snapshot completed successfully Sep 11 21:30:02 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 1073741824" returned: 0 in 0.455s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:02 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 Sep 11 21:30:02 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:03 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733" returned: 0 in 0.287s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2008791942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e450d428-94db-4df1-bca8-4f8e105c2afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1429a7e0aa6d468d836e92a30bac234c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:01Z,use_quota=True,user_id='065aaea607b948f69d86fc0af1f80ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Creating volume e450d428-94db-4df1-bca8-4f8e105c2afc {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:03 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad117111-b953-406d-b3ab-aab17047e21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192e9453-3c73-4c89-9e7a-35f2c7a98733', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6163321-8444-47db-83fb-c330dddcee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:03 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc 1073741824 Sep 11 21:30:03 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:03 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Volume volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 (192e9453-3c73-4c89-9e7a-35f2c7a98733): created successfully Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6163321-8444-47db-83fb-c330dddcee5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Flow 'volume_create_manager' (bd2abd25-a4af-4b0d-ab7d-1a6483c44280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5b92fdd0-5be5-4cc8-bfc0-5cb274b586ff tempest-AttachVolumeNegativeTest-717306620 None] Created volume successfully. Sep 11 21:30:03 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc 1073741824" returned: 0 in 0.605s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:03 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc Sep 11 21:30:03 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Acquiring lock "cinder-097b9b50-6176-4d29-8326-82336e56103d-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-097b9b50-6176-4d29-8326-82336e56103d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Acquiring lock "cinder-quobyte-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-quobyte-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Acquiring lock "cinder-quobyte-097b9b50-6176-4d29-8326-82336e56103d" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-quobyte-097b9b50-6176-4d29-8326-82336e56103d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Deleting offline snapshot 097b9b50-6176-4d29-8326-82336e56103d of volume 6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] snapshot_file for this snap is: volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b880a4-20a9-45f7-aaa5-884fdbc00d84]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:04 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc" returned: 0 in 0.407s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5add77aa-7937-489c-9126-120ced68d8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e450d428-94db-4df1-bca8-4f8e105c2afc', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f3b9fe-d472-4dca-be6b-cca9fef9018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Volume volume-e450d428-94db-4df1-bca8-4f8e105c2afc (e450d428-94db-4df1-bca8-4f8e105c2afc): created successfully Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f3b9fe-d472-4dca-be6b-cca9fef9018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Flow 'volume_create_manager' (d2901bfe-0759-424c-856a-9969b7438a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0a4c7123-9868-405a-881c-da74d32c89d9 tempest-TestMinimumBasicScenario-837360203 None] Created volume successfully. Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:04 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d Sep 11 21:30:04 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Flow 'volume_create_manager' (59c6a881-26e7-41e6-b58e-3ce81136f357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82817e6-2d55-4ab6-9a11-037ea30771ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82817e6-2d55-4ab6-9a11-037ea30771ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1032580145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf191fab-eebe-4c9d-a895-19f51d2afe7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2f27421703414b8198f1f259ef0db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:04Z,use_quota=True,user_id='a97fc69dc4484dbd8391ff495671f7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a4d207-cd2a-4d09-a4c4-0d0cf15b675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a4d207-cd2a-4d09-a4c4-0d0cf15b675e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16c010b-ade6-4997-b95e-8bc43b97e2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16c010b-ade6-4997-b95e-8bc43b97e2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf191fab-eebe-4c9d-a895-19f51d2afe7a', 'volume_name': 'volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1641ea19-08d6-437c-8f69-7efce38605dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1641ea19-08d6-437c-8f69-7efce38605dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92029353-fb8f-49df-9027-a871aa9f25e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Volume bf191fab-eebe-4c9d-a895-19f51d2afe7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a', 'volume_size': 1} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1032580145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf191fab-eebe-4c9d-a895-19f51d2afe7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2f27421703414b8198f1f259ef0db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:04Z,use_quota=True,user_id='a97fc69dc4484dbd8391ff495671f7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Creating volume bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:04 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:04 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a 1073741824 Sep 11 21:30:04 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:04 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d" returned: 0 in 0.735s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fdb9e5-c857-460f-85b8-be9efe462538]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:05 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd Sep 11 21:30:05 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:05 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a 1073741824" returned: 0 in 0.780s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-c62072d2-fd33-454e-84ce-ca873c32467f req-48352c1e-9e6c-40ae-921f-070c89925117 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:05 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a Sep 11 21:30:05 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:05 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" returned: 0 in 0.653s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:05 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d Sep 11 21:30:05 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:05 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a" returned: 0 in 0.290s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-c62072d2-fd33-454e-84ce-ca873c32467f req-48352c1e-9e6c-40ae-921f-070c89925117 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.325s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92029353-fb8f-49df-9027-a871aa9f25e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9afbf3-4810-49a6-8813-f922b1a77cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-c62072d2-fd33-454e-84ce-ca873c32467f req-48352c1e-9e6c-40ae-921f-070c89925117 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:05 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Volume volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a (bf191fab-eebe-4c9d-a895-19f51d2afe7a): created successfully Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9afbf3-4810-49a6-8813-f922b1a77cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Flow 'volume_create_manager' (59c6a881-26e7-41e6-b58e-3ce81136f357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8dbb7b19-4a93-424f-8a63-7a1072190084 tempest-VolumesCloneTest-1473895101 None] Created volume successfully. Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-c62072d2-fd33-454e-84ce-ca873c32467f req-48352c1e-9e6c-40ae-921f-070c89925117 tempest-AttachVolumeNegativeTest-717306620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-192e9453-3c73-4c89-9e7a-35f2c7a98733', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b30e3aa-ac50-4161-8190-057583a11e0d', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:30:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-c62072d2-fd33-454e-84ce-ca873c32467f req-48352c1e-9e6c-40ae-921f-070c89925117 tempest-AttachVolumeNegativeTest-717306620 None] attachment_update completed successfully. Sep 11 21:30:06 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d" returned: 0 in 0.543s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:06 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d Sep 11 21:30:06 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-e93d5722-c21a-4390-8208-ea86996bede5 req-75603120-bd11-4347-8393-a18934020301 tempest-TestMinimumBasicScenario-837360203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-e93d5722-c21a-4390-8208-ea86996bede5 req-75603120-bd11-4347-8393-a18934020301 tempest-TestMinimumBasicScenario-837360203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:06 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-e93d5722-c21a-4390-8208-ea86996bede5 req-75603120-bd11-4347-8393-a18934020301 tempest-TestMinimumBasicScenario-837360203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd.097b9b50-6176-4d29-8326-82336e56103d" returned: 0 in 0.418s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-quobyte-097b9b50-6176-4d29-8326-82336e56103d" released by "_delete_snapshot" :: held 2.569s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-e93d5722-c21a-4390-8208-ea86996bede5 req-75603120-bd11-4347-8393-a18934020301 tempest-TestMinimumBasicScenario-837360203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-e450d428-94db-4df1-bca8-4f8e105c2afc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe5b0272-3d26-4636-bbae-6f74b2369b76', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-quobyte-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" released by "delete_snapshot" :: held 2.616s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Created reservations ['f9bac7de-e09a-41cf-92f7-35e7be3ac5fb', '5b8896dd-bb23-446f-af90-aa3bf5620f6e', 'f9edba86-3dca-4b5f-a707-c89606211541', '54eae3ca-ee91-408c-840c-ec4945773e1d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-e93d5722-c21a-4390-8208-ea86996bede5 req-75603120-bd11-4347-8393-a18934020301 tempest-TestMinimumBasicScenario-837360203 None] attachment_update completed successfully. Sep 11 21:30:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Delete snapshot completed successfully. Sep 11 21:30:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0dfbbe83-e2d2-4a61-9597-aa0a8f382701 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-097b9b50-6176-4d29-8326-82336e56103d-delete_snapshot" released by "delete_snapshot" :: held 2.915s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Acquiring lock "cinder-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Flow 'volume_create_manager' (eb1d44a7-1bc9-40ca-98a1-ef7662845f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66bf084-db20-4842-a91c-99fc6d83f98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66bf084-db20-4842-a91c-99fc6d83f98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1639288318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea175530-0d58-4347-8ce1-10c26446d2e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2f27421703414b8198f1f259ef0db8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bf191fab-eebe-4c9d-a895-19f51d2afe7a,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:07Z,use_quota=True,user_id='a97fc69dc4484dbd8391ff495671f7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f050fe27-0261-44ac-9c0b-9bae4d3e5d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f050fe27-0261-44ac-9c0b-9bae4d3e5d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b176d6-6708-462f-ab84-17bc7c7b83e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b176d6-6708-462f-ab84-17bc7c7b83e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ea175530-0d58-4347-8ce1-10c26446d2e7', 'volume_name': 'volume-ea175530-0d58-4347-8ce1-10c26446d2e7', 'volume_size': 2, 'source_volid': 'bf191fab-eebe-4c9d-a895-19f51d2afe7a', 'source_volstatus': 'available'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c62468-c39c-4573-91f3-afcbcbbcc6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c62468-c39c-4573-91f3-afcbcbbcc6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa1c9c4-2e60-418c-9d53-cb2ccfd62e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Volume ea175530-0d58-4347-8ce1-10c26446d2e7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ea175530-0d58-4347-8ce1-10c26446d2e7', 'volume_size': 2, 'source_volid': 'bf191fab-eebe-4c9d-a895-19f51d2afe7a', 'source_volstatus': 'available'} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Acquiring lock "cinder-quobyte-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:07 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Cloning volume bf191fab-eebe-4c9d-a895-19f51d2afe7a to volume ea175530-0d58-4347-8ce1-10c26446d2e7 Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-quobyte-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Creating offline snapshot 8f1f3804-fa4d-447e-aa4c-d815d293b676 of volume bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66d76c3-1cd5-4750-be80-7971f41acdc7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc753086-8fb7-4e73-bbf0-371bf41e5d78]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:07 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd Sep 11 21:30:07 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:07 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a Sep 11 21:30:07 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:08 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" returned: 0 in 0.412s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:08 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a" returned: 0 in 0.405s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:08 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd Sep 11 21:30:08 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:08 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 1G Sep 11 21:30:08 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:08 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" returned: 0 in 0.436s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-quobyte-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd" released by "delete_volume" :: held 0.935s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Created reservations ['6643f560-c57a-48b5-934e-e2ecb482a14f', '922c0c7d-07c5-4186-9c06-cff76cd74fad', '6b10c036-c565-4774-87f4-d5f227f6ddc7', '2a96fa7f-abcd-455c-9f26-dab30d102951'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:08 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 1G" returned: 0 in 0.694s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:08 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:30:08 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:08 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 Sep 11 21:30:08 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:09 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.321s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:09 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:30:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Deleted volume successfully. Sep 11 21:30:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fc6a8e39-9ada-41f4-9baa-b0b298e9e237 tempest-VolumeSnapshotQuotasNegativeTestJSON-688120215 None] Lock "cinder-6a56f0a8-b0bc-4b98-8ab4-d9f7b00b11fd-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:09 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676" returned: 0 in 0.626s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:09 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 is being set with open permissions: ugo+rw Sep 11 21:30:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:09 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 Sep 11 21:30:09 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-2f7f27bd-fe42-475c-b504-f31ff8f4a6c2 req-a24441b8-00a5-429c-80e5-e3cc0acd6888 tempest-AttachVolumeNegativeTest-717306620 None] Terminate volume connection completed successfully. Sep 11 21:30:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-2f7f27bd-fe42-475c-b504-f31ff8f4a6c2 req-a24441b8-00a5-429c-80e5-e3cc0acd6888 tempest-AttachVolumeNegativeTest-717306620 None] Deleting attachment 2b30e3aa-ac50-4161-8190-057583a11e0d. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:30:09 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676" returned: 0 in 0.292s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:09 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.info Sep 11 21:30:09 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:10 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.info" returned: 0 in 0.454s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:10 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.info is being set with open permissions: ugo+rw Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:10 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.info Sep 11 21:30:10 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:10 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.info" returned: 0 in 0.323s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Acquiring lock "cinder-quobyte-ea175530-0d58-4347-8ce1-10c26446d2e7" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Lock "cinder-quobyte-ea175530-0d58-4347-8ce1-10c26446d2e7" acquired by "_copy_volume_from_snapshot" :: waited 0.072s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] snapshot: 8f1f3804-fa4d-447e-aa4c-d815d293b676, volume: ea175530-0d58-4347-8ce1-10c26446d2e7, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfade8d-a29c-44ee-ae34-87019baa0638]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:11 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 Sep 11 21:30:11 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:11 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676" returned: 0 in 0.825s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:30:11 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[427957dd-6376-49ea-addc-da8504881703]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:11 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a Sep 11 21:30:11 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:12 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a" returned: 0 in 0.518s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:30:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:30:12 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:30:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:12 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 Sep 11 21:30:12 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:30:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:15 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:30:15 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:16 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.573s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:30:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:30:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 28 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:30:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:30:18 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7" returned: 0 in 6.464s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:18 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:30:18 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Converted 1024.00 MB image at 158.36 MB/s Sep 11 21:30:18 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 is being set with open permissions: ugo+rw Sep 11 21:30:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:18 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 Sep 11 21:30:18 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:19 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7" returned: 0 in 0.287s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Lock "cinder-quobyte-ea175530-0d58-4347-8ce1-10c26446d2e7" released by "_copy_volume_from_snapshot" :: held 8.268s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Acquiring lock "cinder-quobyte-8f1f3804-fa4d-447e-aa4c-d815d293b676" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Lock "cinder-quobyte-8f1f3804-fa4d-447e-aa4c-d815d293b676" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Deleting offline snapshot 8f1f3804-fa4d-447e-aa4c-d815d293b676 of volume bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] snapshot_file for this snap is: volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31a11fe-834a-452a-b944-ad6fd55e92dc]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:19 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 Sep 11 21:30:19 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:19 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676" returned: 0 in 0.483s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad06377-302f-4ef5-97d6-72b5d3df21b9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:19 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a Sep 11 21:30:19 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:19 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=80,cinder:SELECT=70,cinder:DELETE=5,cinder:INSERT=22 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:30:20 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a" returned: 0 in 0.773s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:20 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 Sep 11 21:30:20 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:21 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676" returned: 0 in 0.695s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:21 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676 Sep 11 21:30:21 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:21 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a.8f1f3804-fa4d-447e-aa4c-d815d293b676" returned: 0 in 0.488s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Lock "cinder-quobyte-8f1f3804-fa4d-447e-aa4c-d815d293b676" released by "_delete_snapshot" :: held 2.601s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=81,cinder:INSERT=13,cinder:UPDATE=81,cinder:DELETE=9 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.026s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa1c9c4-2e60-418c-9d53-cb2ccfd62e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea175530-0d58-4347-8ce1-10c26446d2e7', 'volume_size': 2, 'source_volid': 'bf191fab-eebe-4c9d-a895-19f51d2afe7a', 'source_volstatus': 'available'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11685c86-6ea9-433f-81c7-5d03e863a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:21 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Volume volume-ea175530-0d58-4347-8ce1-10c26446d2e7 (ea175530-0d58-4347-8ce1-10c26446d2e7): created successfully Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11685c86-6ea9-433f-81c7-5d03e863a817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Flow 'volume_create_manager' (eb1d44a7-1bc9-40ca-98a1-ef7662845f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a2b85f58-84a3-4d57-815f-c79ad6ba3ae3 tempest-VolumesCloneTest-1473895101 None] Created volume successfully. Sep 11 21:30:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Acquiring lock "cinder-ea175530-0d58-4347-8ce1-10c26446d2e7-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Lock "cinder-ea175530-0d58-4347-8ce1-10c26446d2e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Acquiring lock "cinder-quobyte-ea175530-0d58-4347-8ce1-10c26446d2e7" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Lock "cinder-quobyte-ea175530-0d58-4347-8ce1-10c26446d2e7" acquired by "delete_volume" :: waited 0.036s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:23 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[988b45dc-0d44-43d4-8aa6-623f5a434c1c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:23 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 Sep 11 21:30:23 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:23 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7" returned: 0 in 0.582s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:23 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7 Sep 11 21:30:23 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:24 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ea175530-0d58-4347-8ce1-10c26446d2e7" returned: 0 in 0.331s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Lock "cinder-quobyte-ea175530-0d58-4347-8ce1-10c26446d2e7" released by "delete_volume" :: held 0.979s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Created reservations ['7631c37c-f68c-458f-ba1a-f9cf64c55044', 'ebf36aa3-9092-48f2-ba0e-99f0387c8c4f', '8e60af2c-db7d-466a-8061-b7bbb39d1615', '8cb6b1cc-3caf-48b5-bfdf-0a65e50ae3e3'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:24 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:30:24 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:24 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.373s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:30:24 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Deleted volume successfully. Sep 11 21:30:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-84b18026-1d8a-42ab-84d9-032ac20590a1 tempest-VolumesCloneTest-1473895101 None] Lock "cinder-ea175530-0d58-4347-8ce1-10c26446d2e7-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Acquiring lock "cinder-bf191fab-eebe-4c9d-a895-19f51d2afe7a-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Lock "cinder-bf191fab-eebe-4c9d-a895-19f51d2afe7a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Acquiring lock "cinder-quobyte-bf191fab-eebe-4c9d-a895-19f51d2afe7a" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Lock "cinder-quobyte-bf191fab-eebe-4c9d-a895-19f51d2afe7a" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:25 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd187b2-2b09-4793-b100-3d4e21c6f8d1]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:25 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a Sep 11 21:30:25 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:26 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a" returned: 0 in 0.545s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:26 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a Sep 11 21:30:26 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:26 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bf191fab-eebe-4c9d-a895-19f51d2afe7a" returned: 0 in 0.341s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Lock "cinder-quobyte-bf191fab-eebe-4c9d-a895-19f51d2afe7a" released by "delete_volume" :: held 0.974s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Created reservations ['d559b243-7493-4f6e-9933-e082f782ee56', '583798b0-087c-4570-aea4-f2e44c64d73d', '955504db-b557-4dd7-888f-aecc56813840', 'fd458b4e-397a-40cd-b618-9162d6276d24'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:26 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:30:26 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:27 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.363s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:27 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:30:27 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Deleted volume successfully. Sep 11 21:30:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-efd8a89b-e2c8-45ff-95a1-c6e2ad95e50c tempest-VolumesCloneTest-1473895101 None] Lock "cinder-bf191fab-eebe-4c9d-a895-19f51d2afe7a-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Flow 'volume_create_manager' (dc99a587-d806-4c6b-b781-eb8425e8d588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95ddce9-62bb-494f-b896-84ebbf950010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95ddce9-62bb-494f-b896-84ebbf950010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-813304801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495076d8-b65c-4f3f-a23b-609e453ce73d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd35b52ba9ae470e87d0f4d5b9551431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:33Z,use_quota=True,user_id='ad8c8dff263746c9ad1ed689a6a509d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4a13c2-9f00-4753-997c-544e02c02407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4a13c2-9f00-4753-997c-544e02c02407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b909c019-9213-4bdb-8c27-1681808ec9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b909c019-9213-4bdb-8c27-1681808ec9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495076d8-b65c-4f3f-a23b-609e453ce73d', 'volume_name': 'volume-495076d8-b65c-4f3f-a23b-609e453ce73d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a205b80f-96bb-42f7-a695-ec4152535828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a205b80f-96bb-42f7-a695-ec4152535828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a1ddc-e526-466c-b8ab-74415b1dd290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:33 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Volume 495076d8-b65c-4f3f-a23b-609e453ce73d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495076d8-b65c-4f3f-a23b-609e453ce73d', 'volume_size': 1} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-813304801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495076d8-b65c-4f3f-a23b-609e453ce73d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd35b52ba9ae470e87d0f4d5b9551431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:33Z,use_quota=True,user_id='ad8c8dff263746c9ad1ed689a6a509d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Creating volume 495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:33 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:30:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:33 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d 1073741824 Sep 11 21:30:33 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:34 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d 1073741824" returned: 0 in 0.583s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:34 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d Sep 11 21:30:34 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:34 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d" returned: 0 in 0.464s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:30:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a1ddc-e526-466c-b8ab-74415b1dd290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495076d8-b65c-4f3f-a23b-609e453ce73d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b2f641-eb3f-4e66-b6b8-918f2900cd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:34 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Volume volume-495076d8-b65c-4f3f-a23b-609e453ce73d (495076d8-b65c-4f3f-a23b-609e453ce73d): created successfully Sep 11 21:30:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b2f641-eb3f-4e66-b6b8-918f2900cd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Flow 'volume_create_manager' (dc99a587-d806-4c6b-b781-eb8425e8d588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-59a67c4d-98d4-41cb-9e4a-787efb4dc482 tempest-VolumesDeleteCascade-615872540 None] Created volume successfully. Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Flow 'volume_create_manager' (c8a7e835-e9b8-4918-846d-4ac7ed183119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c09a113-ae94-4b38-b140-175769d84d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c09a113-ae94-4b38-b140-175769d84d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-180041965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa06ba3-3fde-4dca-a3e9-df338528b2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba12c2f75fa4b5aa2bea181c122525c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:35Z,use_quota=True,user_id='208b553789204853befbd068e299de7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420514f4-0eca-46fc-83b6-d02f70c2f67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420514f4-0eca-46fc-83b6-d02f70c2f67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f45b59d-a49d-4e21-ad23-a69eca775323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f45b59d-a49d-4e21-ad23-a69eca775323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa06ba3-3fde-4dca-a3e9-df338528b2b6', 'volume_name': 'volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6', 'volume_size': 2}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0979c2e1-0907-4f7e-a606-0d3887efbad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0979c2e1-0907-4f7e-a606-0d3887efbad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db1cbf8-8e75-423c-8b12-afda583f7a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:35 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Volume bfa06ba3-3fde-4dca-a3e9-df338528b2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6', 'volume_size': 2} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-180041965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa06ba3-3fde-4dca-a3e9-df338528b2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba12c2f75fa4b5aa2bea181c122525c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:35Z,use_quota=True,user_id='208b553789204853befbd068e299de7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Creating volume bfa06ba3-3fde-4dca-a3e9-df338528b2b6 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:35 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:30:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 2147483648 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:35 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 2147483648 Sep 11 21:30:35 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:36 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 2147483648" returned: 0 in 0.966s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:36 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 Sep 11 21:30:36 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:36 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6" returned: 0 in 0.320s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.337s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Creating offline snapshot fd5ff0a1-d3c3-44a0-a571-253a2c030a75 of volume 495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db1cbf8-8e75-423c-8b12-afda583f7a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6', 'volume_size': 2}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a99493e-3265-4b20-982c-d4570d20114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b671172a-4b2e-4415-a414-bd08d9a11ea8]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:36 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Volume volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 (bfa06ba3-3fde-4dca-a3e9-df338528b2b6): created successfully Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a99493e-3265-4b20-982c-d4570d20114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Flow 'volume_create_manager' (c8a7e835-e9b8-4918-846d-4ac7ed183119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:36 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3aaf1d68-2923-4202-aa89-5c0eaeba4ac1 tempest-VolumesCloneNegativeTest-1952813673 None] Created volume successfully. Sep 11 21:30:36 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d Sep 11 21:30:36 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:37 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d" returned: 0 in 0.576s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:37 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 1G Sep 11 21:30:37 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Acquiring lock "cinder-bfa06ba3-3fde-4dca-a3e9-df338528b2b6-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "cinder-bfa06ba3-3fde-4dca-a3e9-df338528b2b6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Acquiring lock "cinder-quobyte-bfa06ba3-3fde-4dca-a3e9-df338528b2b6" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "cinder-quobyte-bfa06ba3-3fde-4dca-a3e9-df338528b2b6" acquired by "delete_volume" :: waited 0.031s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[59651f29-305d-484e-8a86-4b467a644a99]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:37 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 Sep 11 21:30:37 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:37 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 1G" returned: 0 in 0.669s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495076d8-b65c-4f3f-a23b-609e453ce73d -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:37 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495076d8-b65c-4f3f-a23b-609e453ce73d -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 Sep 11 21:30:37 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:38 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6" returned: 0 in 0.412s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:38 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6 Sep 11 21:30:38 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:38 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495076d8-b65c-4f3f-a23b-609e453ce73d -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75" returned: 0 in 0.377s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:38 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 is being set with open permissions: ugo+rw Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:38 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 Sep 11 21:30:38 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:38 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bfa06ba3-3fde-4dca-a3e9-df338528b2b6" returned: 0 in 0.350s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "cinder-quobyte-bfa06ba3-3fde-4dca-a3e9-df338528b2b6" released by "delete_volume" :: held 0.839s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Created reservations ['1589ac1d-d63b-4fb0-b1c8-9f41ee029c15', 'b26d7bc6-227c-4c3b-8a1f-708478bee711', '36d8ee4f-bf93-4f4c-8829-b9cdbdc54f97', 'cc1325a7-1c07-4078-97e4-7be36d161d33'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:38 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75" returned: 0 in 0.379s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:38 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:30:38 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:38 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.info Sep 11 21:30:38 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:38 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.288s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:38 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:30:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Deleted volume successfully. Sep 11 21:30:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98a8a169-80e2-409c-9fe5-ed039a7a2c70 tempest-VolumesCloneNegativeTest-1952813673 None] Lock "cinder-bfa06ba3-3fde-4dca-a3e9-df338528b2b6-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:39 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.info" returned: 0 in 0.374s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:39 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.info is being set with open permissions: ugo+rw Sep 11 21:30:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:39 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.info Sep 11 21:30:39 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:39 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.info" returned: 0 in 0.289s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.829s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-28532c41-73af-487b-9012-70793df20ef2 tempest-VolumesDeleteCascade-615872540 None] Create snapshot completed successfully Sep 11 21:30:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Creating offline snapshot 128df07b-a561-4538-a268-d1f5e4cba760 of volume 495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:30:40 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b55af0-af66-42f6-bf2d-6fed085b77f7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:40 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 Sep 11 21:30:40 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:41 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75" returned: 0 in 0.501s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-495076d8-b65c-4f3f-a23b-609e453ce73d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:30:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:41 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 1G Sep 11 21:30:41 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:42 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 1G" returned: 0 in 0.674s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:42 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 Sep 11 21:30:42 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:42 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760" returned: 0 in 0.450s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:42 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 is being set with open permissions: ugo+rw Sep 11 21:30:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:42 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 Sep 11 21:30:42 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:42 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760" returned: 0 in 0.295s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:42 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5e6879f4-978b-4fb9-8a0a-4703274c3c21 tempest-VolumesDeleteCascade-615872540 None] Create snapshot completed successfully Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-495076d8-b65c-4f3f-a23b-609e453ce73d-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-495076d8-b65c-4f3f-a23b-609e453ce73d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Performing cascade delete. {{(pid=87423) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-128df07b-a561-4538-a268-d1f5e4cba760-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-128df07b-a561-4538-a268-d1f5e4cba760-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-495076d8-b65c-4f3f-a23b-609e453ce73d" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-495076d8-b65c-4f3f-a23b-609e453ce73d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-128df07b-a561-4538-a268-d1f5e4cba760" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-128df07b-a561-4538-a268-d1f5e4cba760" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Deleting offline snapshot 128df07b-a561-4538-a268-d1f5e4cba760 of volume 495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] snapshot_file for this snap is: volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaef87b1-eb07-4e0a-9e0b-ea2ba202080f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:44 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 Sep 11 21:30:44 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:44 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760" returned: 0 in 0.446s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-495076d8-b65c-4f3f-a23b-609e453ce73d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3af1ef-0de1-44ab-87de-9878cfef482c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:44 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 Sep 11 21:30:44 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:45 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75" returned: 0 in 0.457s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-495076d8-b65c-4f3f-a23b-609e453ce73d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:30:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:45 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 Sep 11 21:30:45 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:45 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760" returned: 0 in 0.426s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:45 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760 Sep 11 21:30:45 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:45 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.128df07b-a561-4538-a268-d1f5e4cba760" returned: 0 in 0.283s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-128df07b-a561-4538-a268-d1f5e4cba760" released by "_delete_snapshot" :: held 1.733s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-495076d8-b65c-4f3f-a23b-609e453ce73d" released by "delete_snapshot" :: held 1.757s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Created reservations ['ee3d8f69-99a9-4358-80b8-39e81734e5e8', '5c5633ae-4da6-45ca-b943-0c270053e44d', 'c6166e9e-b8f6-4a62-9da6-3a0ea5f84323', '25935e11-7b7f-4ba1-9fa0-e1b3854eee6a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Delete snapshot completed successfully. Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-128df07b-a561-4538-a268-d1f5e4cba760-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-fd5ff0a1-d3c3-44a0-a571-253a2c030a75-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-fd5ff0a1-d3c3-44a0-a571-253a2c030a75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-495076d8-b65c-4f3f-a23b-609e453ce73d" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-495076d8-b65c-4f3f-a23b-609e453ce73d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-fd5ff0a1-d3c3-44a0-a571-253a2c030a75" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-fd5ff0a1-d3c3-44a0-a571-253a2c030a75" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Deleting offline snapshot fd5ff0a1-d3c3-44a0-a571-253a2c030a75 of volume 495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] snapshot_file for this snap is: volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1243ff4a-b9ff-4d38-b786-5062ad9f3384]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:46 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 Sep 11 21:30:46 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:46 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75" returned: 0 in 0.474s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-495076d8-b65c-4f3f-a23b-609e453ce73d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7e272-0c81-4663-b7e2-eae356a56c41]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:46 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d Sep 11 21:30:46 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:47 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d" returned: 0 in 0.369s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:47 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 Sep 11 21:30:47 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:47 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75" returned: 0 in 0.373s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:47 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75 Sep 11 21:30:47 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:47 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d.fd5ff0a1-d3c3-44a0-a571-253a2c030a75" returned: 0 in 0.250s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-fd5ff0a1-d3c3-44a0-a571-253a2c030a75" released by "_delete_snapshot" :: held 1.589s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-495076d8-b65c-4f3f-a23b-609e453ce73d" released by "delete_snapshot" :: held 1.614s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Created reservations ['485e9806-4939-4c9a-b12b-cfd59ee2c99d', 'a62bcf1c-6bbf-46b7-8d66-f4521f55df5c', '3bbc3061-082e-4294-8bfd-785bf419d803', '288aabcd-5aa5-4738-9464-6dffd7f58cf0'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:47 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Delete snapshot completed successfully. Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-fd5ff0a1-d3c3-44a0-a571-253a2c030a75-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Snapshots deleted, issuing volume delete {{(pid=87423) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-495076d8-b65c-4f3f-a23b-609e453ce73d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-495076d8-b65c-4f3f-a23b-609e453ce73d" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8422fa1c-f37e-4f04-912e-61ae643b3c22]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Flow 'volume_create_manager' (0a741917-8f42-4c83-87bf-d44f20958ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c50130-3e1c-4c0c-8335-1af88458d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:48 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d Sep 11 21:30:48 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c50130-3e1c-4c0c-8335-1af88458d49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1775983578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006c3fb8-67fa-409c-8078-bc6529e9e313,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ff8f71d794528943b4d6dd6819eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:48Z,use_quota=True,user_id='242365b214d54312a9ab7db7a41df5ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facd8c16-63f6-462a-8e8e-764067ca5321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facd8c16-63f6-462a-8e8e-764067ca5321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa53b4f-ed08-42d0-bf35-238febf59b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa53b4f-ed08-42d0-bf35-238febf59b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006c3fb8-67fa-409c-8078-bc6529e9e313', 'volume_name': 'volume-006c3fb8-67fa-409c-8078-bc6529e9e313', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d85a815-3f80-430f-9d1d-fd3e094aec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d85a815-3f80-430f-9d1d-fd3e094aec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17091f51-bf16-400d-a155-22492e6fd02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:48 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Volume 006c3fb8-67fa-409c-8078-bc6529e9e313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006c3fb8-67fa-409c-8078-bc6529e9e313', 'volume_size': 1} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1775983578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006c3fb8-67fa-409c-8078-bc6529e9e313,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ff8f71d794528943b4d6dd6819eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:48Z,use_quota=True,user_id='242365b214d54312a9ab7db7a41df5ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Creating volume 006c3fb8-67fa-409c-8078-bc6529e9e313 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:48 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:48 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313 1073741824 Sep 11 21:30:48 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:48 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d" returned: 0 in 0.359s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:48 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d Sep 11 21:30:48 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:48 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313 1073741824" returned: 0 in 0.446s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:48 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-495076d8-b65c-4f3f-a23b-609e453ce73d" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-495076d8-b65c-4f3f-a23b-609e453ce73d" released by "delete_volume" :: held 0.678s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:48 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313 Sep 11 21:30:48 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Created reservations ['d8d97413-e7e8-4c19-9d65-80c6c73e7bee', 'c9d761b2-84cd-49e8-aae8-3fded486ede5', '089b77f3-a441-4072-88a9-54ef2ea09fde', '16b850c1-63c4-4a95-952d-7858161a8e23'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:48 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:30:48 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:48 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313" returned: 0 in 0.251s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17091f51-bf16-400d-a155-22492e6fd02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006c3fb8-67fa-409c-8078-bc6529e9e313', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f01ec8b-f896-42ae-85d8-9c9a779ad707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:48 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Volume volume-006c3fb8-67fa-409c-8078-bc6529e9e313 (006c3fb8-67fa-409c-8078-bc6529e9e313): created successfully Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f01ec8b-f896-42ae-85d8-9c9a779ad707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Flow 'volume_create_manager' (0a741917-8f42-4c83-87bf-d44f20958ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:48 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c3d16ddb-b0e6-4e0b-802f-90febce59aaa tempest-VolumesListTestJSON-1486294785 None] Created volume successfully. Sep 11 21:30:49 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.263s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:30:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Deleted volume successfully. Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-30849ef6-a80d-406a-b644-fe092561a60c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-495076d8-b65c-4f3f-a23b-609e453ce73d-delete_volume" released by "delete_volume" :: held 4.998s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Flow 'volume_create_manager' (d6dd9f5f-44c8-43b7-97df-0460128ceca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f12fb3-909e-4313-96df-7e9287c710e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f12fb3-909e-4313-96df-7e9287c710e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-277568075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ff8f71d794528943b4d6dd6819eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:50Z,use_quota=True,user_id='242365b214d54312a9ab7db7a41df5ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13e9452-9f4d-4b5f-9dee-4bedea5fa409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13e9452-9f4d-4b5f-9dee-4bedea5fa409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7886c201-5284-45fe-9d6b-98b3dc436480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7886c201-5284-45fe-9d6b-98b3dc436480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0', 'volume_name': 'volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2b97a4-7ee5-4bb6-843d-7c5cc83955c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2b97a4-7ee5-4bb6-843d-7c5cc83955c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1889dd43-0764-4169-8866-79ff108b96ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:49 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Volume 9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0', 'volume_size': 1} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-277568075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ff8f71d794528943b4d6dd6819eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:50Z,use_quota=True,user_id='242365b214d54312a9ab7db7a41df5ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Creating volume 9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:49 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:30:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:49 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 1073741824 Sep 11 21:30:49 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:50 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 1073741824" returned: 0 in 0.503s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:50 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 Sep 11 21:30:50 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Flow 'volume_create_manager' (1cbd1c76-087e-4922-911a-37b0c18c944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84642a2-0bf2-4711-8fc7-60769a455525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84642a2-0bf2-4711-8fc7-60769a455525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1254314862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034b170d-3bf8-4d16-9e3a-c7003f3e635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd35b52ba9ae470e87d0f4d5b9551431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:50Z,use_quota=True,user_id='ad8c8dff263746c9ad1ed689a6a509d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d733fdb-165c-4013-a005-261a8a2ca171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d733fdb-165c-4013-a005-261a8a2ca171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f593e7d-477e-48b3-ad81-46c8dc5f34cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f593e7d-477e-48b3-ad81-46c8dc5f34cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034b170d-3bf8-4d16-9e3a-c7003f3e635e', 'volume_name': 'volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28143d71-b35e-4bfd-812c-b3b6ac3a6984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28143d71-b35e-4bfd-812c-b3b6ac3a6984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a30e5d-ac89-4237-a16f-2b78c6e5b04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Volume 034b170d-3bf8-4d16-9e3a-c7003f3e635e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e', 'volume_size': 1} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:50 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0" returned: 0 in 0.278s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1254314862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034b170d-3bf8-4d16-9e3a-c7003f3e635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd35b52ba9ae470e87d0f4d5b9551431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:50Z,use_quota=True,user_id='ad8c8dff263746c9ad1ed689a6a509d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Creating volume 034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:50 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:50 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e 1073741824 Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1889dd43-0764-4169-8866-79ff108b96ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:50 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d769ccd1-251c-4748-a0f1-cb39b8b3f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Volume volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 (9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0): created successfully Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d769ccd1-251c-4748-a0f1-cb39b8b3f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Flow 'volume_create_manager' (d6dd9f5f-44c8-43b7-97df-0460128ceca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9b0d8662-f599-492f-863b-b800ec962784 tempest-VolumesListTestJSON-1486294785 None] Created volume successfully. Sep 11 21:30:50 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e 1073741824" returned: 0 in 0.484s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:51 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e Sep 11 21:30:51 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:51 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e" returned: 0 in 0.287s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:30:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a30e5d-ac89-4237-a16f-2b78c6e5b04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6889ff06-2f58-4a9f-a4ee-0d893906cffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:51 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Volume volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e (034b170d-3bf8-4d16-9e3a-c7003f3e635e): created successfully Sep 11 21:30:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6889ff06-2f58-4a9f-a4ee-0d893906cffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Flow 'volume_create_manager' (1cbd1c76-087e-4922-911a-37b0c18c944c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:51 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-75acb750-0b7d-4eac-ae25-e90b0339e75b tempest-VolumesDeleteCascade-615872540 None] Created volume successfully. Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Flow 'volume_create_manager' (a4ec4975-9bf7-434e-ba6c-cb2d9af621b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba15d04-4df0-4ec0-912b-89ef11826c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba15d04-4df0-4ec0-912b-89ef11826c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-105634328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99538ea-3026-4ee5-85b7-5f6680a8c9a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ff8f71d794528943b4d6dd6819eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:52Z,use_quota=True,user_id='242365b214d54312a9ab7db7a41df5ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb11e4d-aa79-441d-9ac2-f7dc6af4d522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb11e4d-aa79-441d-9ac2-f7dc6af4d522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31cc15e-b956-4561-b146-bbe3bea9cf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31cc15e-b956-4561-b146-bbe3bea9cf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a99538ea-3026-4ee5-85b7-5f6680a8c9a1', 'volume_name': 'volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e8e8b7-7c40-456a-a1b7-93f1a34eb475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e8e8b7-7c40-456a-a1b7-93f1a34eb475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2346d6a7-efb9-492d-b979-94578c6d33f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:52 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Volume a99538ea-3026-4ee5-85b7-5f6680a8c9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1', 'volume_size': 1} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-105634328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99538ea-3026-4ee5-85b7-5f6680a8c9a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec8ff8f71d794528943b4d6dd6819eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:52Z,use_quota=True,user_id='242365b214d54312a9ab7db7a41df5ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Creating volume a99538ea-3026-4ee5-85b7-5f6680a8c9a1 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:52 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:52 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 1073741824 Sep 11 21:30:52 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:52 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 1073741824" returned: 0 in 0.505s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:52 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 Sep 11 21:30:52 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:53 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1" returned: 0 in 0.252s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.391s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2346d6a7-efb9-492d-b979-94578c6d33f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14700605-be8b-4d89-af20-3e952b7b21bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Creating offline snapshot a4ce2ed3-0914-4078-9772-25a9c5819858 of volume 034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:30:53 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Volume volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 (a99538ea-3026-4ee5-85b7-5f6680a8c9a1): created successfully Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14700605-be8b-4d89-af20-3e952b7b21bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Flow 'volume_create_manager' (a4ec4975-9bf7-434e-ba6c-cb2d9af621b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[09571332-615c-4f36-b558-785e1ef804e2]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:53 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-10165859-748a-45b8-ae5a-89478ab21199 tempest-VolumesListTestJSON-1486294785 None] Created volume successfully. Sep 11 21:30:53 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e Sep 11 21:30:53 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:53 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e" returned: 0 in 0.427s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:53 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 1G Sep 11 21:30:53 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:54 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 1G" returned: 0 in 0.460s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:54 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 Sep 11 21:30:54 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:54 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858" returned: 0 in 0.479s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:54 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 is being set with open permissions: ugo+rw Sep 11 21:30:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:54 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 Sep 11 21:30:54 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:54 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858" returned: 0 in 0.495s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:55 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.info Sep 11 21:30:55 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:55 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.info" returned: 0 in 0.295s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:55 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.info is being set with open permissions: ugo+rw Sep 11 21:30:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:55 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.info Sep 11 21:30:55 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:55 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.info" returned: 0 in 0.345s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.666s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:55 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-16101221-5e88-4014-a5a4-d3e916a0ed74 tempest-VolumesDeleteCascade-615872540 None] Create snapshot completed successfully Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Flow 'volume_create_manager' (cea968fb-0b0f-4155-b817-7b94a8c75a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95c6cad-46c7-4975-88d9-912daa98d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95c6cad-46c7-4975-88d9-912daa98d41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-814286178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9661e3b3-e72b-4f75-a2e0-6847dcee38ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd35b52ba9ae470e87d0f4d5b9551431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4ce2ed3-0914-4078-9772-25a9c5819858,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:57Z,use_quota=True,user_id='ad8c8dff263746c9ad1ed689a6a509d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673ceb39-7988-4a3b-aaf4-feecb38917a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673ceb39-7988-4a3b-aaf4-feecb38917a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e951badc-11c1-4fb3-b30a-7f83741ba2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e951badc-11c1-4fb3-b30a-7f83741ba2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9661e3b3-e72b-4f75-a2e0-6847dcee38ae', 'volume_name': 'volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae', 'volume_size': 1, 'snapshot_id': 'a4ce2ed3-0914-4078-9772-25a9c5819858'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86510c5-d18f-4788-aa2e-58cc26fb678c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86510c5-d18f-4788-aa2e-58cc26fb678c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76caea5c-da58-465f-961d-21543e79ba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:56 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Volume 9661e3b3-e72b-4f75-a2e0-6847dcee38ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae', 'volume_size': 1, 'snapshot_id': 'a4ce2ed3-0914-4078-9772-25a9c5819858'} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-a4ce2ed3-0914-4078-9772-25a9c5819858-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" by "_create_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-8eb5633b-f3de-4075-acb1-0e3ccfb92d5c req-970ca9db-145a-4f5a-a1f2-3e59fb219bc4 tempest-TestMinimumBasicScenario-837360203 None] Terminate volume connection completed successfully. Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-8eb5633b-f3de-4075-acb1-0e3ccfb92d5c req-970ca9db-145a-4f5a-a1f2-3e59fb219bc4 tempest-TestMinimumBasicScenario-837360203 None] Deleting attachment fe5b0272-3d26-4636-bbae-6f74b2369b76. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-a4ce2ed3-0914-4078-9772-25a9c5819858-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Creating volume 9661e3b3-e72b-4f75-a2e0-6847dcee38ae from snapshot a4ce2ed3-0914-4078-9772-25a9c5819858 {{(pid=87423) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] snapshot: a4ce2ed3-0914-4078-9772-25a9c5819858, volume: 9661e3b3-e72b-4f75-a2e0-6847dcee38ae, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37e814f-9f93-43c6-b253-860b85a5dfcd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Flow 'volume_create_manager' (229b61a3-1181-43c9-b0bf-68f56211ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:30:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0012a4-a1df-4111-bbb2-b4862d3395c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0012a4-a1df-4111-bbb2-b4862d3395c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-350369103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca3de66-f12f-475c-8616-9958527cd0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e17b521db643249bf19c1ff277c77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:57Z,use_quota=True,user_id='291740fd7eba49a3bf4ef155f69c8a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968bc02-282c-4214-ab76-2b595cd66e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:57 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 Sep 11 21:30:57 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968bc02-282c-4214-ab76-2b595cd66e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce900cc-38c7-4228-ae58-a1c82b61343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce900cc-38c7-4228-ae58-a1c82b61343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca3de66-f12f-475c-8616-9958527cd0c2', 'volume_name': 'volume-5ca3de66-f12f-475c-8616-9958527cd0c2', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3cc47a-4d8e-45e1-b646-8e71d1bd1524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3cc47a-4d8e-45e1-b646-8e71d1bd1524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060c7121-9b63-4840-8b0b-d95d946a94ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:30:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Volume 5ca3de66-f12f-475c-8616-9958527cd0c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca3de66-f12f-475c-8616-9958527cd0c2', 'volume_size': 1} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Acquiring lock "cinder-e450d428-94db-4df1-bca8-4f8e105c2afc-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Lock "cinder-e450d428-94db-4df1-bca8-4f8e105c2afc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Acquiring lock "cinder-quobyte-e450d428-94db-4df1-bca8-4f8e105c2afc" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Lock "cinder-quobyte-e450d428-94db-4df1-bca8-4f8e105c2afc" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:57 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858" returned: 0 in 0.486s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[727bf8ec-dfee-4e09-8111-c6a2d491bfc5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31fc456-290a-4e7e-b7d6-c533ea3bc293]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:57 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc Sep 11 21:30:57 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:57 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e Sep 11 21:30:57 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "cinder-a99538ea-3026-4ee5-85b7-5f6680a8c9a1-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-a99538ea-3026-4ee5-85b7-5f6680a8c9a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "cinder-quobyte-a99538ea-3026-4ee5-85b7-5f6680a8c9a1" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-quobyte-a99538ea-3026-4ee5-85b7-5f6680a8c9a1" acquired by "delete_volume" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d38f31-e093-4b31-be13-19ae98f768a5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:57 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc" returned: 0 in 0.434s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:57 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:57 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc Sep 11 21:30:57 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e" returned: 0 in 0.456s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:30:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:57 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae Sep 11 21:30:57 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:57 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 Sep 11 21:30:57 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:58 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e450d428-94db-4df1-bca8-4f8e105c2afc" returned: 0 in 0.263s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Lock "cinder-quobyte-e450d428-94db-4df1-bca8-4f8e105c2afc" released by "delete_volume" :: held 0.764s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Created reservations ['5ddb3259-691f-40cc-9afb-c16718063381', '0924cebe-b5e7-4590-a230-0f441c1df6bb', '4e5270b0-7d24-402f-a417-386feacacc76', 'b98ea79f-8ab0-4e02-886e-29f7e8a153d8'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:58 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1" returned: 0 in 0.433s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:58 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1 Sep 11 21:30:58 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:58 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:30:58 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:30:58 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a99538ea-3026-4ee5-85b7-5f6680a8c9a1" returned: 0 in 0.474s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:58 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.514s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-quobyte-a99538ea-3026-4ee5-85b7-5f6680a8c9a1" released by "delete_volume" :: held 1.028s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Deleted volume successfully. Sep 11 21:30:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02b93233-b110-4cb8-98dd-7579b5109024 tempest-TestMinimumBasicScenario-837360203 None] Lock "cinder-e450d428-94db-4df1-bca8-4f8e105c2afc-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:30:59 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Created reservations ['71116cea-4118-4d06-b083-bb6d4241d7b6', 'c63e3768-921f-4da3-8483-a61a474286a3', 'bb5770d0-2d8c-4f9d-9301-4a5182667895', '20b39100-ae12-46d2-835b-97fca454be26'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:30:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:30:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:30:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:30:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:30:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:30:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:30:59 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:30:59 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:00 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.953s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:00 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:00 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Deleted volume successfully. Sep 11 21:31:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "cinder-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee932347-4eda-43c2-a478-f2aaabb78ff0 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-a99538ea-3026-4ee5-85b7-5f6680a8c9a1-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "cinder-quobyte-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-quobyte-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0" acquired by "delete_volume" :: waited 0.058s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:00 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b69a606-68ff-42cc-a2ae-9604f2fc8024]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:00 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 Sep 11 21:31:00 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:01 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0" returned: 0 in 0.644s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:01 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0 Sep 11 21:31:01 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:01 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0" returned: 0 in 0.726s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-quobyte-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0" released by "delete_volume" :: held 1.478s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:02 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Created reservations ['8e7887c3-87d3-412e-9252-7f8a09640a98', 'be276ba3-f2c2-4841-beff-e4ef6f43bc2d', '66d9c05c-9e15-487a-bf8a-67431d526740', 'b8737e10-0cab-432b-ab39-9c8cd06d9ec3'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:02 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:02 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "cinder-006c3fb8-67fa-409c-8078-bc6529e9e313-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-006c3fb8-67fa-409c-8078-bc6529e9e313-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "cinder-quobyte-006c3fb8-67fa-409c-8078-bc6529e9e313" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:03 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-quobyte-006c3fb8-67fa-409c-8078-bc6529e9e313" acquired by "delete_volume" :: waited 0.052s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.991s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:03 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Deleted volume successfully. Sep 11 21:31:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e8f58b-2972-492d-b1dc-b8454ef2a0f4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2931f63e-0651-4041-9d6b-e9ea0f2ba684 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-9798bd9f-ebdb-45e0-af0a-0dbe8d2e85d0-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:03 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313 Sep 11 21:31:03 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:04 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313" returned: 0 in 0.924s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:04 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:04 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313 Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" returned: 0 in 6.447s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:31:04 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Converted 1024.00 MB image at 158.81 MB/s Sep 11 21:31:04 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:04 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae is being set with open permissions: ugo+rw Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:04 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae Sep 11 21:31:04 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:04 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-006c3fb8-67fa-409c-8078-bc6529e9e313" returned: 0 in 0.277s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-quobyte-006c3fb8-67fa-409c-8078-bc6529e9e313" released by "delete_volume" :: held 1.300s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:04 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" returned: 0 in 0.261s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" released by "_copy_volume_from_snapshot" :: held 7.775s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-a4ce2ed3-0914-4078-9772-25a9c5819858-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" released by "_create_volume_from_snapshot" :: held 7.862s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.881s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.578s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-350369103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca3de66-f12f-475c-8616-9958527cd0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e17b521db643249bf19c1ff277c77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:30:57Z,use_quota=True,user_id='291740fd7eba49a3bf4ef155f69c8a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Creating volume 5ca3de66-f12f-475c-8616-9958527cd0c2 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:31:04 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Created reservations ['8b96f4e6-2482-4ec6-ba06-220889357a93', '073a8746-bd28-4c54-bd38-817ee550ad25', 'a1e8adec-d215-42fc-81c2-b7ab00dd32d8', 'f5b5ccf4-5db6-43f0-bdad-74190653cdb4'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:04 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2 1073741824 Sep 11 21:31:04 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76caea5c-da58-465f-961d-21543e79ba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae', 'volume_size': 1, 'snapshot_id': 'a4ce2ed3-0914-4078-9772-25a9c5819858'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e3fbe0-ddaa-47b7-8ced-8e401b9b93fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Volume volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae (9661e3b3-e72b-4f75-a2e0-6847dcee38ae): created successfully Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e3fbe0-ddaa-47b7-8ced-8e401b9b93fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Flow 'volume_create_manager' (cea968fb-0b0f-4155-b817-7b94a8c75a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:31:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c011431f-d760-49da-80b2-53d128582c0e tempest-VolumesDeleteCascade-615872540 None] Created volume successfully. Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:04 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:04 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:05 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.273s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Deleted volume successfully. Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fb074f03-5d25-4587-8569-cccc05317628 tempest-VolumesListTestJSON-1486294785 None] Lock "cinder-006c3fb8-67fa-409c-8078-bc6529e9e313-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:05 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2 1073741824" returned: 0 in 0.517s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:05 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2 Sep 11 21:31:05 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:05 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2" returned: 0 in 0.260s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060c7121-9b63-4840-8b0b-d95d946a94ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca3de66-f12f-475c-8616-9958527cd0c2', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbd805f-ef2e-4f7d-9bc0-4f638091dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:05 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Volume volume-5ca3de66-f12f-475c-8616-9958527cd0c2 (5ca3de66-f12f-475c-8616-9958527cd0c2): created successfully Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbd805f-ef2e-4f7d-9bc0-4f638091dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Flow 'volume_create_manager' (229b61a3-1181-43c9-b0bf-68f56211ea49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:31:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d9bf46ee-6f12-4a78-8cd8-8f0d47731866 tempest-AttachVolumeNegativeTest-717306620 None] Created volume successfully. Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-034b170d-3bf8-4d16-9e3a-c7003f3e635e-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-034b170d-3bf8-4d16-9e3a-c7003f3e635e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Performing cascade delete. {{(pid=87423) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-a4ce2ed3-0914-4078-9772-25a9c5819858-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-a4ce2ed3-0914-4078-9772-25a9c5819858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-034b170d-3bf8-4d16-9e3a-c7003f3e635e" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-034b170d-3bf8-4d16-9e3a-c7003f3e635e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-a4ce2ed3-0914-4078-9772-25a9c5819858" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-a4ce2ed3-0914-4078-9772-25a9c5819858" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Deleting offline snapshot a4ce2ed3-0914-4078-9772-25a9c5819858 of volume 034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:31:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] snapshot_file for this snap is: volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:31:06 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f999f3-57fd-4f46-ac39-5abdd56cc7ac]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:06 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 Sep 11 21:31:06 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:06 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858" returned: 0 in 0.485s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:31:06 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eba85f-5c08-446f-8dce-c40a0bd9b2e2]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:06 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e Sep 11 21:31:06 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-5d53e56e-8b86-475e-b43c-6a9a1191b765 req-05fe6690-1b3a-449a-8448-ece39ad60236 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-5d53e56e-8b86-475e-b43c-6a9a1191b765 req-05fe6690-1b3a-449a-8448-ece39ad60236 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-5d53e56e-8b86-475e-b43c-6a9a1191b765 req-05fe6690-1b3a-449a-8448-ece39ad60236 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-5d53e56e-8b86-475e-b43c-6a9a1191b765 req-05fe6690-1b3a-449a-8448-ece39ad60236 tempest-AttachVolumeNegativeTest-717306620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-5ca3de66-f12f-475c-8616-9958527cd0c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02315b32-e377-4610-a865-63951fe086aa', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:31:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-5d53e56e-8b86-475e-b43c-6a9a1191b765 req-05fe6690-1b3a-449a-8448-ece39ad60236 tempest-AttachVolumeNegativeTest-717306620 None] attachment_update completed successfully. Sep 11 21:31:07 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e" returned: 0 in 0.827s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:07 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 Sep 11 21:31:07 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:07 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858" returned: 0 in 0.370s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:07 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858 Sep 11 21:31:07 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:08 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e.a4ce2ed3-0914-4078-9772-25a9c5819858" returned: 0 in 0.333s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-a4ce2ed3-0914-4078-9772-25a9c5819858" released by "_delete_snapshot" :: held 2.153s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-034b170d-3bf8-4d16-9e3a-c7003f3e635e" released by "delete_snapshot" :: held 2.181s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Created reservations ['5df05ed0-3ed0-4348-84b1-3cbbe1528172', 'd6808ab8-9263-433a-a8d7-ec4fb0b54cd1', 'ea7b1a91-815c-42f6-837b-a3d49961b60c', '322f3ab6-cd1b-49eb-bb08-99c9077c221b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:08 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Delete snapshot completed successfully. Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-a4ce2ed3-0914-4078-9772-25a9c5819858-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Snapshots deleted, issuing volume delete {{(pid=87423) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-034b170d-3bf8-4d16-9e3a-c7003f3e635e" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-034b170d-3bf8-4d16-9e3a-c7003f3e635e" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcc1c91-d63a-48cb-9d7b-6c1298049824]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:08 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e Sep 11 21:31:08 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:08 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e" returned: 0 in 0.411s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:08 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e Sep 11 21:31:08 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:09 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-034b170d-3bf8-4d16-9e3a-c7003f3e635e" returned: 0 in 0.383s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-034b170d-3bf8-4d16-9e3a-c7003f3e635e" released by "delete_volume" :: held 0.876s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Created reservations ['c16821ff-f9e0-40fb-82bf-7c96b2c80486', 'c7de045a-3e33-4e4e-a7c7-45e8231e226e', '87bd681c-2d2a-4358-9175-528eeb61b0e5', '34d0c7f2-cb6a-4f53-897b-ceac1404caf3'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:09 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:09 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:09 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.376s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Deleted volume successfully. Sep 11 21:31:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4933397f-6681-42bc-835d-a4488e873d7c tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-034b170d-3bf8-4d16-9e3a-c7003f3e635e-delete_volume" released by "delete_volume" :: held 4.027s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-58f0d5fd-f8c8-407a-9e9c-af67e356fecb req-f9f5fdaa-e51b-435d-8c0d-72bd56c23cd4 tempest-AttachVolumeNegativeTest-717306620 None] Terminate volume connection completed successfully. Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-58f0d5fd-f8c8-407a-9e9c-af67e356fecb req-f9f5fdaa-e51b-435d-8c0d-72bd56c23cd4 tempest-AttachVolumeNegativeTest-717306620 None] Deleting attachment 02315b32-e377-4610-a865-63951fe086aa. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Flow 'volume_create_manager' (42adce75-4935-4f7a-99ff-cb28e9b3661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b3e301-b0d8-49a9-8775-3b21b31ae39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b3e301-b0d8-49a9-8775-3b21b31ae39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-743348344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68575219-c16c-4dfb-9621-3fa133470cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659dfd3a804a4845b3f44b669788a3c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:31:10Z,use_quota=True,user_id='2454872f503b471ca324cd54d8d2dd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd255a8-36d4-44bd-a7b3-131fab3aa353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd255a8-36d4-44bd-a7b3-131fab3aa353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca1cee6-627f-4eb5-8d2c-634024a416d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca1cee6-627f-4eb5-8d2c-634024a416d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68575219-c16c-4dfb-9621-3fa133470cf5', 'volume_name': 'volume-68575219-c16c-4dfb-9621-3fa133470cf5', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d5373f-4a09-4447-874a-180f0e891b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d5373f-4a09-4447-874a-180f0e891b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e29c68-7252-4a8e-833c-c5345fc18fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:10 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Volume 68575219-c16c-4dfb-9621-3fa133470cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68575219-c16c-4dfb-9621-3fa133470cf5', 'volume_size': 1} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-743348344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68575219-c16c-4dfb-9621-3fa133470cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659dfd3a804a4845b3f44b669788a3c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:31:10Z,use_quota=True,user_id='2454872f503b471ca324cd54d8d2dd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Creating volume 68575219-c16c-4dfb-9621-3fa133470cf5 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:31:10 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-9661e3b3-e72b-4f75-a2e0-6847dcee38ae-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:10 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5 1073741824 Sep 11 21:31:10 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-9661e3b3-e72b-4f75-a2e0-6847dcee38ae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "cinder-quobyte-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3dcc97-358b-46fc-8449-2117cab1fd71]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:10 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae Sep 11 21:31:10 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:11 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5 1073741824" returned: 0 in 0.579s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:11 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" returned: 0 in 0.495s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:11 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae Sep 11 21:31:11 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:11 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5 Sep 11 21:31:11 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:11 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5" returned: 0 in 0.499s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e29c68-7252-4a8e-833c-c5345fc18fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68575219-c16c-4dfb-9621-3fa133470cf5', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:11 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daab4c77-058e-4eca-a6ef-abe9c7339b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" returned: 0 in 0.602s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-quobyte-9661e3b3-e72b-4f75-a2e0-6847dcee38ae" released by "delete_volume" :: held 1.146s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:11 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Volume volume-68575219-c16c-4dfb-9621-3fa133470cf5 (68575219-c16c-4dfb-9621-3fa133470cf5): created successfully Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daab4c77-058e-4eca-a6ef-abe9c7339b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Flow 'volume_create_manager' (42adce75-4935-4f7a-99ff-cb28e9b3661e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:31:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-dae66de8-896f-4efc-9451-0d0db63dfa4b tempest-VolumesNegativeTest-2058459406 None] Created volume successfully. Sep 11 21:31:11 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Created reservations ['29393321-736b-441e-9bed-efe29b83b365', 'b94b5fd9-ee3d-43b3-b1a8-88e69d640a86', 'dc8607da-d190-4651-b2bf-4c98586c11d9', '4a6e9bf4-0fae-4438-b956-ee5aec39e58e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:12 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:12 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:12 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:12 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Deleted volume successfully. Sep 11 21:31:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-097a102d-ed51-40eb-8e37-1d1d8306b528 tempest-VolumesDeleteCascade-615872540 None] Lock "cinder-9661e3b3-e72b-4f75-a2e0-6847dcee38ae-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:31:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:15 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:15 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:16 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.457s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:31:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 28 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:31:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:31:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "cinder-5ca3de66-f12f-475c-8616-9958527cd0c2-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-5ca3de66-f12f-475c-8616-9958527cd0c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "cinder-quobyte-5ca3de66-f12f-475c-8616-9958527cd0c2" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-quobyte-5ca3de66-f12f-475c-8616-9958527cd0c2" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:17 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53d7894-839b-4fac-8313-0366dd7368c5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:17 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2 Sep 11 21:31:17 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:17 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2" returned: 0 in 0.616s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:17 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2 Sep 11 21:31:17 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:18 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5ca3de66-f12f-475c-8616-9958527cd0c2" returned: 0 in 0.285s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-quobyte-5ca3de66-f12f-475c-8616-9958527cd0c2" released by "delete_volume" :: held 0.963s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Created reservations ['9e9c16ea-8906-47b9-8384-bff8a9f04cc7', '9957167a-70c3-4630-ad2c-6ae2df2c8d0e', '97d8a621-fa24-4bb1-9697-31d534b26115', '83c934a1-8af9-45f4-8153-e2e9d02ef971'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:18 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:18 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:18 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.317s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:18 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Deleted volume successfully. Sep 11 21:31:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9410fee4-3080-478c-a755-9da2911a4299 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-5ca3de66-f12f-475c-8616-9958527cd0c2-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "cinder-192e9453-3c73-4c89-9e7a-35f2c7a98733-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-192e9453-3c73-4c89-9e7a-35f2c7a98733-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "cinder-quobyte-192e9453-3c73-4c89-9e7a-35f2c7a98733" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-quobyte-192e9453-3c73-4c89-9e7a-35f2c7a98733" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:19 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2a8a79-2487-40bb-af17-a7eeca8f71fb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:19 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 Sep 11 21:31:19 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:20 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733" returned: 0 in 0.450s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:20 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733 Sep 11 21:31:20 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:20 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-192e9453-3c73-4c89-9e7a-35f2c7a98733" returned: 0 in 0.339s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-quobyte-192e9453-3c73-4c89-9e7a-35f2c7a98733" released by "delete_volume" :: held 0.856s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=142,cinder:SELECT=113,cinder:INSERT=36,cinder:DELETE=14 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Created reservations ['be1a7abf-01f0-4760-8dee-fd7450fece28', 'c4d4174e-bdbf-4090-91c6-bafd4b82f620', '72d77cd6-83ae-442a-b63b-60df6805c83b', '5df8b203-b735-4876-9c11-6b7cefd100eb'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:20 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:20 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "cinder-19fcd84d-0389-4ddd-a366-4ec6e72cad1c-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-19fcd84d-0389-4ddd-a366-4ec6e72cad1c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:21 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "cinder-quobyte-19fcd84d-0389-4ddd-a366-4ec6e72cad1c" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.387s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Deleted volume successfully. Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-quobyte-19fcd84d-0389-4ddd-a366-4ec6e72cad1c" acquired by "delete_volume" :: waited 0.042s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9328a254-0148-4961-b72b-3d5530f1f816 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-192e9453-3c73-4c89-9e7a-35f2c7a98733-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d85d1b1-5037-4cf4-8826-dadbe0c53dc7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:21 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c Sep 11 21:31:21 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:21 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c" returned: 0 in 0.449s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:21 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c Sep 11 21:31:21 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:21 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-19fcd84d-0389-4ddd-a366-4ec6e72cad1c" returned: 0 in 0.296s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-quobyte-19fcd84d-0389-4ddd-a366-4ec6e72cad1c" released by "delete_volume" :: held 0.809s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:21 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=145,cinder:SELECT=117,cinder:INSERT=34,cinder:DELETE=10 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Created reservations ['92fefa2a-123a-4a94-8190-8be3ff018217', 'db383558-61a7-4905-8016-a89c8825443d', '90beda0a-e03e-447d-b62a-8fc65449a89d', 'f741c9ed-bcb8-4360-9e65-d35da960cdaf'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:22 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:22 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:22 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.550s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Deleted volume successfully. Sep 11 21:31:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f1a504bb-0c89-466c-a180-168b63fd6e26 tempest-AttachVolumeNegativeTest-717306620 None] Lock "cinder-19fcd84d-0389-4ddd-a366-4ec6e72cad1c-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:32 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:31:32 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:31:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-50fbee19-e93c-4d01-a0e5-d21e9028ae86 tempest-GroupSnapshotsTest-1283956610 None] Group tempest-GroupSnapshotsTest-Group-340151055: creating Sep 11 21:31:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-50fbee19-e93c-4d01-a0e5-d21e9028ae86 tempest-GroupSnapshotsTest-1283956610 None] Group tempest-GroupSnapshotsTest-Group-340151055: created successfully Sep 11 21:31:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-50fbee19-e93c-4d01-a0e5-d21e9028ae86 tempest-GroupSnapshotsTest-1283956610 None] Create group completed successfully. Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Flow 'volume_create_manager' (9c7320db-cf14-494f-99f6-d8ffa63e37fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b5e678-440c-4978-bc38-fdb3c5e52c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b5e678-440c-4978-bc38-fdb3c5e52c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2060260177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43738272-7720-4c6d-b649-ca8f74993d66,host='devstack@QuobyteHD#QuobyteHD',id=2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31d38b769340b58af4b68c3aaec851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:31:41Z,use_quota=True,user_id='4159830803274e438caa9bf736fd553f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d76b6d4-f3bb-4b0e-bb99-6016e70a25eb),volume_type_id=3d76b6d4-f3bb-4b0e-bb99-6016e70a25eb)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593eb314-1189-4a74-88cc-d2ee6365c234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593eb314-1189-4a74-88cc-d2ee6365c234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00af64e1-5f46-428e-935d-a867c08851c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00af64e1-5f46-428e-935d-a867c08851c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9', 'volume_name': 'volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa4ea2d-2968-4635-b75c-a5064f9ef924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa4ea2d-2968-4635-b75c-a5064f9ef924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae69490-c70e-4d2f-9674-62572604f97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:40 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Volume 2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9', 'volume_size': 1} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43738272-7720-4c6d-b649-ca8f74993d66,created_at=2026-09-11T19:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2060260177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43738272-7720-4c6d-b649-ca8f74993d66,host='devstack@QuobyteHD#QuobyteHD',id=2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31d38b769340b58af4b68c3aaec851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:31:41Z,use_quota=True,user_id='4159830803274e438caa9bf736fd553f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d76b6d4-f3bb-4b0e-bb99-6016e70a25eb),volume_type_id=3d76b6d4-f3bb-4b0e-bb99-6016e70a25eb)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Creating volume 2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:31:40 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:31:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:40 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 1073741824 Sep 11 21:31:40 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:41 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 1073741824" returned: 0 in 0.530s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:41 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 Sep 11 21:31:41 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:41 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" returned: 0 in 0.380s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:31:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae69490-c70e-4d2f-9674-62572604f97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a83314-57b5-49ec-a77f-1c8d82bd02fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:41 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Volume volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 (2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9): created successfully Sep 11 21:31:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a83314-57b5-49ec-a77f-1c8d82bd02fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Flow 'volume_create_manager' (9c7320db-cf14-494f-99f6-d8ffa63e37fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:31:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2d042ea7-b2bf-43b6-8e45-7554dd09f423 tempest-GroupSnapshotsTest-1283956610 None] Created volume successfully. Sep 11 21:31:43 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] GroupSnapshot f1139558-7e76-48ba-a261-465643561df6: creating. Sep 11 21:31:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Group snapshot f1139558-7e76-48ba-a261-465643561df6: creating. {{(pid=87423) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 21:31:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Creating offline snapshot 78a6d48a-2501-42d4-93c6-3e5ce376012b of volume 2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:31:43 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f716f86d-a239-43df-a3b9-bc128e7931e4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:43 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 Sep 11 21:31:43 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:44 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" returned: 0 in 0.497s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:44 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b 1G Sep 11 21:31:44 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:44 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b 1G" returned: 0 in 0.641s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:44 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b Sep 11 21:31:44 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:45 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b" returned: 0 in 0.363s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:45 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:31:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:45 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b Sep 11 21:31:45 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:45 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b" returned: 0 in 0.382s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:45 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.info Sep 11 21:31:45 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:45 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.info" returned: 0 in 0.366s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:45 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:31:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:45 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.info Sep 11 21:31:45 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:46 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.info" returned: 0 in 0.310s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-eb6c1a6b-68d5-41b8-9cba-e4251fef0eca tempest-GroupSnapshotsTest-1283956610 None] group_snapshot f1139558-7e76-48ba-a261-465643561df6: created successfully Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-78a6d48a-2501-42d4-93c6-3e5ce376012b-bc63c1f8-2baf-4d82-ade9-870e17d5a870" by "_create_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-78a6d48a-2501-42d4-93c6-3e5ce376012b-bc63c1f8-2baf-4d82-ade9-870e17d5a870" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Creating volume bc63c1f8-2baf-4d82-ade9-870e17d5a870 from snapshot 78a6d48a-2501-42d4-93c6-3e5ce376012b {{(pid=87423) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-bc63c1f8-2baf-4d82-ade9-870e17d5a870" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-bc63c1f8-2baf-4d82-ade9-870e17d5a870" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] snapshot: 78a6d48a-2501-42d4-93c6-3e5ce376012b, volume: bc63c1f8-2baf-4d82-ade9-870e17d5a870, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[844dcf81-285c-4a57-99eb-de9104c55724]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:48 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b Sep 11 21:31:48 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:48 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b" returned: 0 in 0.773s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:31:48 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626a41b-b4c5-49d1-866b-5fd4776e49ab]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:48 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 Sep 11 21:31:48 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:49 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" returned: 0 in 0.566s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:49 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 Sep 11 21:31:49 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Acquiring lock "cinder-68575219-c16c-4dfb-9621-3fa133470cf5-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Lock "cinder-68575219-c16c-4dfb-9621-3fa133470cf5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Acquiring lock "cinder-quobyte-68575219-c16c-4dfb-9621-3fa133470cf5" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Lock "cinder-quobyte-68575219-c16c-4dfb-9621-3fa133470cf5" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7538ae-30d8-4cbd-af90-4a2c15f8046a]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:50 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5 Sep 11 21:31:50 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:50 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5" returned: 0 in 0.976s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:50 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5 Sep 11 21:31:50 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:52 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-68575219-c16c-4dfb-9621-3fa133470cf5" returned: 0 in 1.201s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Lock "cinder-quobyte-68575219-c16c-4dfb-9621-3fa133470cf5" released by "delete_volume" :: held 2.254s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Created reservations ['295bbbaa-bf82-4e87-a091-4bf67d59406a', '2a502f7c-7bc1-41af-89ae-779e022f863b', '3f4be1f1-9063-4d65-b9ea-cfac502f296d', 'c71221d9-6861-4d51-9c10-7d6364a54179'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:52 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:52 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:52 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.493s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:52 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:52 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Deleted volume successfully. Sep 11 21:31:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73662530-ed53-4102-91ac-33363e3096c4 tempest-VolumesNegativeTest-2058459406 None] Lock "cinder-68575219-c16c-4dfb-9621-3fa133470cf5-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:55 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870" returned: 0 in 6.541s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:55 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:31:55 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Converted 1024.00 MB image at 156.52 MB/s Sep 11 21:31:55 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:31:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:55 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 Sep 11 21:31:55 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:56 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870" returned: 0 in 0.297s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-bc63c1f8-2baf-4d82-ade9-870e17d5a870" released by "_copy_volume_from_snapshot" :: held 8.312s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-78a6d48a-2501-42d4-93c6-3e5ce376012b-bc63c1f8-2baf-4d82-ade9-870e17d5a870" released by "_create_volume_from_snapshot" :: held 8.412s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.450s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-48141ffd-99c1-4f03-b46b-2de80d270b41 tempest-GroupSnapshotsTest-1283956610 None] Create group from source-snapshot-f1139558-7e76-48ba-a261-465643561df6 completed successfully. Sep 11 21:31:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-bc63c1f8-2baf-4d82-ade9-870e17d5a870" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-bc63c1f8-2baf-4d82-ade9-870e17d5a870" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:56 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dba063-64c6-4a3f-a2be-8b5e8e482760]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:57 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 Sep 11 21:31:57 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:57 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870" returned: 0 in 0.498s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:57 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870 Sep 11 21:31:57 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:57 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bc63c1f8-2baf-4d82-ade9-870e17d5a870" returned: 0 in 0.321s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-bc63c1f8-2baf-4d82-ade9-870e17d5a870" released by "delete_volume" :: held 0.897s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:31:57 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['560982fa-aac6-45c5-8a7e-9f7d0fc878bd'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:57 devstack cinder-volume[87423]: WARNING cinder.quota [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1825513377 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1825513377, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:31:57 devstack cinder-volume[87423]: WARNING cinder.quota [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1825513377 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1825513377, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:31:57 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['45bde140-3dc3-40d2-9af3-79f0179e8685', '2642e469-6066-4773-9b54-e4ff0aa8ca5c', 'f8f487f2-b774-4805-8f8f-8a0407abb885', '8a30cc1a-7c92-40e2-af7c-e8988e947cbc'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:31:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:58 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:31:58 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:58 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 11 21:31:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.347s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:31:58 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:31:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-37fa08b1-6f44-4ca1-a371-3bcf3c248555 tempest-GroupSnapshotsTest-1283956610 None] Delete group completed successfully. Sep 11 21:31:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] group_snapshot f1139558-7e76-48ba-a261-465643561df6: deleting Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] group_snapshot f1139558-7e76-48ba-a261-465643561df6: deleting {{(pid=87423) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-78a6d48a-2501-42d4-93c6-3e5ce376012b" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-78a6d48a-2501-42d4-93c6-3e5ce376012b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Deleting offline snapshot 78a6d48a-2501-42d4-93c6-3e5ce376012b of volume 2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] snapshot_file for this snap is: volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df80dd9-51ec-41ff-b900-c5bde0dc706f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Flow 'volume_create_manager' (b441b489-847e-4eb6-bf02-4a91ad3f31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0454e5b9-bc2e-4787-a292-7e8f33e3d970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:59 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b Sep 11 21:31:59 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0454e5b9-bc2e-4787-a292-7e8f33e3d970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1378574815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39b36f2-9cf6-4114-9380-c1e73c555dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe89439f5e91493f9405d4ee9422a834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:00Z,use_quota=True,user_id='2af24fe5255d465ca178100171d05709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4feb08f-3a46-44b5-80a2-07a3ad1ac76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4feb08f-3a46-44b5-80a2-07a3ad1ac76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd94ced-2321-4873-84f7-4c0fbe0f3fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd94ced-2321-4873-84f7-4c0fbe0f3fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd39b36f2-9cf6-4114-9380-c1e73c555dc5', 'volume_name': 'volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9213f4ce-4509-486e-bfe8-ce3100aace7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9213f4ce-4509-486e-bfe8-ce3100aace7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a91268a-38ac-4be0-9a0e-1f0204b362fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:31:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Volume d39b36f2-9cf6-4114-9380-c1e73c555dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5', 'volume_size': 1} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1378574815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39b36f2-9cf6-4114-9380-c1e73c555dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe89439f5e91493f9405d4ee9422a834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:00Z,use_quota=True,user_id='2af24fe5255d465ca178100171d05709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Creating volume d39b36f2-9cf6-4114-9380-c1e73c555dc5 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:31:59 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:31:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:31:59 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 1073741824 Sep 11 21:31:59 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:00 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b" returned: 0 in 0.722s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f69946-613c-4a6b-b3f0-fd2ca437c054]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Flow 'volume_create_manager' (2b44aa39-caf0-498a-a0b4-97b0d8af0fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cd5cce-f9c4-463f-917a-a0d99b8abc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cd5cce-f9c4-463f-917a-a0d99b8abc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2107709013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c6850d-699f-4a97-8cbd-112da5b1c971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe89439f5e91493f9405d4ee9422a834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:00Z,use_quota=True,user_id='2af24fe5255d465ca178100171d05709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0047cd07-22a3-490d-b310-d167a4c3dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0047cd07-22a3-490d-b310-d167a4c3dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b8c6f8-05ab-44dd-a2a8-ef177dddedcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b8c6f8-05ab-44dd-a2a8-ef177dddedcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c6850d-699f-4a97-8cbd-112da5b1c971', 'volume_name': 'volume-74c6850d-699f-4a97-8cbd-112da5b1c971', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:00 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea950f2-364d-4621-93e6-6899a107da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:00 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea950f2-364d-4621-93e6-6899a107da26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d9f098-ef4c-4907-bf83-996aea1bbeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:00 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Volume 74c6850d-699f-4a97-8cbd-112da5b1c971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c6850d-699f-4a97-8cbd-112da5b1c971', 'volume_size': 1} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:00 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 1073741824" returned: 0 in 0.792s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:00 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 Sep 11 21:32:00 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:01 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5" returned: 0 in 0.415s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2107709013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c6850d-699f-4a97-8cbd-112da5b1c971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe89439f5e91493f9405d4ee9422a834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:00Z,use_quota=True,user_id='2af24fe5255d465ca178100171d05709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Creating volume 74c6850d-699f-4a97-8cbd-112da5b1c971 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:01 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:01 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971 1073741824 Sep 11 21:32:01 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a91268a-38ac-4be0-9a0e-1f0204b362fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada7ad44-517d-45ff-bdcd-14a9bc49a3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:01 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" returned: 0 in 0.951s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:01 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Volume volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 (d39b36f2-9cf6-4114-9380-c1e73c555dc5): created successfully Sep 11 21:32:01 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada7ad44-517d-45ff-bdcd-14a9bc49a3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:01 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Flow 'volume_create_manager' (b441b489-847e-4eb6-bf02-4a91ad3f31de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-375f0970-620f-42d6-840b-b0aac6366c61 tempest-TestServerVolumeAttachmentScenario-222870486 None] Created volume successfully. Sep 11 21:32:01 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971 1073741824" returned: 0 in 0.773s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:01 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b" returned: 0 in 0.666s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:02 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b Sep 11 21:32:02 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:02 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971 Sep 11 21:32:02 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:02 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9.78a6d48a-2501-42d4-93c6-3e5ce376012b" returned: 0 in 0.304s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-78a6d48a-2501-42d4-93c6-3e5ce376012b" released by "_delete_snapshot" :: held 2.828s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" released by "delete_snapshot" :: held 2.872s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:02 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971" returned: 0 in 0.382s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d9f098-ef4c-4907-bf83-996aea1bbeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c6850d-699f-4a97-8cbd-112da5b1c971', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122d5289-5edf-4873-82ae-181ebfeb07ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:02 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Volume volume-74c6850d-699f-4a97-8cbd-112da5b1c971 (74c6850d-699f-4a97-8cbd-112da5b1c971): created successfully Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122d5289-5edf-4873-82ae-181ebfeb07ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Flow 'volume_create_manager' (2b44aa39-caf0-498a-a0b4-97b0d8af0fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:02 devstack cinder-volume[87423]: WARNING cinder.quota [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1825513377 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1825513377, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:32:02 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5f3b652d-4948-4f99-af5e-6b1542ba6cae tempest-TestServerVolumeAttachmentScenario-222870486 None] Created volume successfully. Sep 11 21:32:02 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['5f0de4a7-56af-4e23-a588-386b4794c625', '2a6d7f4e-e237-481f-8120-64db23fae285', 'a9a7625b-5e70-47ec-86dc-d57d96b0b607', 'e68ef208-29c3-4c9f-b5ea-416f1822eb27'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:02 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ff8a70ac-a0af-43fe-bd5c-c149620daf29 tempest-GroupSnapshotsTest-1283956610 None] group_snapshot f1139558-7e76-48ba-a261-465643561df6: deleted successfully Sep 11 21:32:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e068db11-a978-47b9-ada1-7e2fa5973418]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:03 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 Sep 11 21:32:03 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:03 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" returned: 0 in 0.430s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:03 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9 Sep 11 21:32:03 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:04 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" returned: 0 in 0.340s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-2fc6f1a7-f4f5-4a09-b504-c9b06bd740d9" released by "delete_volume" :: held 0.875s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['f4b39109-6c4b-48ff-87a3-edbbb32a15a0'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:04 devstack cinder-volume[87423]: WARNING cinder.db.api [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1825513377'] Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['829cd3e9-0f79-40e5-89aa-8a3fa2ccbf1f', '41f9de3a-150c-4bc1-8847-a76462a9216d', '91499c3c-1cf8-4754-8c0e-8c3779ac1ecf', '836a6ca8-d49b-49cf-988c-c05686de8763'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Flow 'volume_create_manager' (b94088e7-97cb-4680-9d4b-6b4a4adabdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbdf88c-8699-4db8-b3ba-3c06e3bb3a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbdf88c-8699-4db8-b3ba-3c06e3bb3a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-485311708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1645230-1a9d-43e9-bc38-b848ad35c130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bb5e4db9ca4a02be56f9f88332fe9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:05Z,use_quota=True,user_id='98272b883a1c4953bc26cbe73c858c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa51ed01-74c8-43c7-b744-5943199ef341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa51ed01-74c8-43c7-b744-5943199ef341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8112e4ce-a1e7-4067-9635-4ec3b2a7f3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8112e4ce-a1e7-4067-9635-4ec3b2a7f3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1645230-1a9d-43e9-bc38-b848ad35c130', 'volume_name': 'volume-e1645230-1a9d-43e9-bc38-b848ad35c130', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d1ea25-6b18-4528-aa15-b05cfab4532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d1ea25-6b18-4528-aa15-b05cfab4532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed58ff7d-18cd-436d-8bac-5e1e9237221c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Volume e1645230-1a9d-43e9-bc38-b848ad35c130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1645230-1a9d-43e9-bc38-b848ad35c130', 'volume_size': 1} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-485311708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1645230-1a9d-43e9-bc38-b848ad35c130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bb5e4db9ca4a02be56f9f88332fe9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:05Z,use_quota=True,user_id='98272b883a1c4953bc26cbe73c858c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Creating volume e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:04 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:04 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 1073741824 Sep 11 21:32:04 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:04 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:32:04 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:05 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.418s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:05 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:32:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3b6b1eff-dff2-4a87-b170-e84076ab7a3f tempest-GroupSnapshotsTest-1283956610 None] Delete group completed successfully. Sep 11 21:32:05 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 1073741824" returned: 0 in 0.658s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:05 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 Sep 11 21:32:05 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:05 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130" returned: 0 in 0.450s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:32:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed58ff7d-18cd-436d-8bac-5e1e9237221c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1645230-1a9d-43e9-bc38-b848ad35c130', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071b4e34-4d8b-4e91-8812-66a2e8c09fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:06 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Volume volume-e1645230-1a9d-43e9-bc38-b848ad35c130 (e1645230-1a9d-43e9-bc38-b848ad35c130): created successfully Sep 11 21:32:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071b4e34-4d8b-4e91-8812-66a2e8c09fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Flow 'volume_create_manager' (b94088e7-97cb-4680-9d4b-6b4a4adabdb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6677f9d4-88be-408a-8610-58776e78325f tempest-TestStampPattern-1722604090 None] Created volume successfully. Sep 11 21:32:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0398fa38-bb49-42cd-b136-8e7ab24620d9 tempest-GroupSnapshotsTest-1283956610 None] Group tempest-GroupSnapshotsTest-Group-2127190364: creating Sep 11 21:32:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0398fa38-bb49-42cd-b136-8e7ab24620d9 tempest-GroupSnapshotsTest-1283956610 None] Group tempest-GroupSnapshotsTest-Group-2127190364: created successfully Sep 11 21:32:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0398fa38-bb49-42cd-b136-8e7ab24620d9 tempest-GroupSnapshotsTest-1283956610 None] Create group completed successfully. Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Flow 'volume_create_manager' (cc797353-99ed-41ee-9078-999482934b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4145ab-182d-4b84-8961-7e124c304f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4145ab-182d-4b84-8961-7e124c304f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-441868928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbd8ceaa-a5a3-4841-acdb-c4acf07af89e,host='devstack@QuobyteHD#QuobyteHD',id=6871ed5a-4be4-4392-b0bf-8f9f37a73e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31d38b769340b58af4b68c3aaec851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:08Z,use_quota=True,user_id='4159830803274e438caa9bf736fd553f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9d8bb47-c558-49ee-8f78-f1cb30fc1296),volume_type_id=d9d8bb47-c558-49ee-8f78-f1cb30fc1296)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccef5732-e602-4342-8bbc-cbc90c62fa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccef5732-e602-4342-8bbc-cbc90c62fa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987f009d-b13a-4664-b0c6-3fb288b16cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987f009d-b13a-4664-b0c6-3fb288b16cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6871ed5a-4be4-4392-b0bf-8f9f37a73e08', 'volume_name': 'volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc095cdd-d085-4c05-b3ee-d4b825b537a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc095cdd-d085-4c05-b3ee-d4b825b537a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c571d49-a5e9-44c2-abc3-68acb869d246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:08 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Volume 6871ed5a-4be4-4392-b0bf-8f9f37a73e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08', 'volume_size': 1} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bbd8ceaa-a5a3-4841-acdb-c4acf07af89e,created_at=2026-09-11T19:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-441868928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbd8ceaa-a5a3-4841-acdb-c4acf07af89e,host='devstack@QuobyteHD#QuobyteHD',id=6871ed5a-4be4-4392-b0bf-8f9f37a73e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31d38b769340b58af4b68c3aaec851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:08Z,use_quota=True,user_id='4159830803274e438caa9bf736fd553f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9d8bb47-c558-49ee-8f78-f1cb30fc1296),volume_type_id=d9d8bb47-c558-49ee-8f78-f1cb30fc1296)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Creating volume 6871ed5a-4be4-4392-b0bf-8f9f37a73e08 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:08 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:32:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:08 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 1073741824 Sep 11 21:32:08 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:09 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 1073741824" returned: 0 in 0.566s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:09 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 Sep 11 21:32:09 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:09 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" returned: 0 in 0.301s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:32:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c571d49-a5e9-44c2-abc3-68acb869d246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df5308a-8982-475e-99a0-301e57ec1575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:09 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Volume volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 (6871ed5a-4be4-4392-b0bf-8f9f37a73e08): created successfully Sep 11 21:32:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df5308a-8982-475e-99a0-301e57ec1575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Flow 'volume_create_manager' (cc797353-99ed-41ee-9078-999482934b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3c08d27d-c0da-4b3e-b323-7f2c64ff1ed6 tempest-GroupSnapshotsTest-1283956610 None] Created volume successfully. Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Flow 'volume_create_manager' (f4aa69a4-5e95-44a4-a9a4-6e2fb244dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdee98c-daa8-4cc9-adde-303d855e104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdee98c-daa8-4cc9-adde-303d855e104d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-84279059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbd8ceaa-a5a3-4841-acdb-c4acf07af89e,host='devstack@QuobyteHD#QuobyteHD',id=340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31d38b769340b58af4b68c3aaec851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:12Z,use_quota=True,user_id='4159830803274e438caa9bf736fd553f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9d8bb47-c558-49ee-8f78-f1cb30fc1296),volume_type_id=d9d8bb47-c558-49ee-8f78-f1cb30fc1296)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0b0da8-6beb-4404-a863-9e7afad16e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0b0da8-6beb-4404-a863-9e7afad16e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbd746a-76cf-408a-835b-eccd4f9e1dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbd746a-76cf-408a-835b-eccd4f9e1dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0', 'volume_name': 'volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6034643b-a04b-4b27-bc1b-218df1c0cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6034643b-a04b-4b27-bc1b-218df1c0cf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf79d5e-14a6-4447-a4b3-5eb7845aa235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:11 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Volume 340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0', 'volume_size': 1} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bbd8ceaa-a5a3-4841-acdb-c4acf07af89e,created_at=2026-09-11T19:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-84279059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bbd8ceaa-a5a3-4841-acdb-c4acf07af89e,host='devstack@QuobyteHD#QuobyteHD',id=340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31d38b769340b58af4b68c3aaec851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:12Z,use_quota=True,user_id='4159830803274e438caa9bf736fd553f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9d8bb47-c558-49ee-8f78-f1cb30fc1296),volume_type_id=d9d8bb47-c558-49ee-8f78-f1cb30fc1296)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Creating volume 340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:11 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:32:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:11 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 1073741824 Sep 11 21:32:11 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:12 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 1073741824" returned: 0 in 0.526s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:12 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 Sep 11 21:32:12 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:12 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:32:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf79d5e-14a6-4447-a4b3-5eb7845aa235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeb9d45-cdc8-47be-9867-59922bacfce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:12 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Volume volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 (340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0): created successfully Sep 11 21:32:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeb9d45-cdc8-47be-9867-59922bacfce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Flow 'volume_create_manager' (f4aa69a4-5e95-44a4-a9a4-6e2fb244dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c5f913c5-8a31-407a-9a60-7da9d20c6912 tempest-GroupSnapshotsTest-1283956610 None] Created volume successfully. Sep 11 21:32:14 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a1617961-98c0-4c4c-a29e-4e2a9cdc2157 tempest-GroupSnapshotsTest-1283956610 None] Update group completed successfully. Sep 11 21:32:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:32:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:15 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:32:15 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-7166a1ee-a272-4d6d-bc2a-97378fef4bb8 tempest-GroupSnapshotsTest-1283956610 None] Update group completed successfully. Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (7ae089c9-3789-457d-b34d-c1ebbe94643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5411b9a-3cc3-4f87-b0dc-de4866115caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5411b9a-3cc3-4f87-b0dc-de4866115caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-992903541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873ff71c-8ee9-4d42-84af-18a6a09da57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8b8ca97f74c2291b2fa5d8d707b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:16Z,use_quota=True,user_id='bc0920054efd4b7389247d373258ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db2dcae-bd77-4fe0-8916-aba9a7ff0da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db2dcae-bd77-4fe0-8916-aba9a7ff0da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638edb83-51e9-44cd-9ec2-531769336549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638edb83-51e9-44cd-9ec2-531769336549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873ff71c-8ee9-4d42-84af-18a6a09da57b', 'volume_name': 'volume-873ff71c-8ee9-4d42-84af-18a6a09da57b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:16 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd35b28-8063-46c8-9238-77146717821e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd35b28-8063-46c8-9238-77146717821e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae9207c-dd02-4440-81d6-3c32704476f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:16 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Volume 873ff71c-8ee9-4d42-84af-18a6a09da57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873ff71c-8ee9-4d42-84af-18a6a09da57b', 'volume_size': 1} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-992903541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873ff71c-8ee9-4d42-84af-18a6a09da57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8b8ca97f74c2291b2fa5d8d707b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:16Z,use_quota=True,user_id='bc0920054efd4b7389247d373258ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Creating volume 873ff71c-8ee9-4d42-84af-18a6a09da57b {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:16 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.625s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 28 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:32:16 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b 1073741824 Sep 11 21:32:16 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:16 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b 1073741824" returned: 0 in 0.490s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:16 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b Sep 11 21:32:16 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:17 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b" returned: 0 in 0.312s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:32:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae9207c-dd02-4440-81d6-3c32704476f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873ff71c-8ee9-4d42-84af-18a6a09da57b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022a4d96-2d1a-42f3-bcf9-907558f22da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:17 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Volume volume-873ff71c-8ee9-4d42-84af-18a6a09da57b (873ff71c-8ee9-4d42-84af-18a6a09da57b): created successfully Sep 11 21:32:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022a4d96-2d1a-42f3-bcf9-907558f22da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (7ae089c9-3789-457d-b34d-c1ebbe94643b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e136d4e9-0fcc-4e47-82a9-446ba2e3cc48 tempest-VolumesSnapshotTestJSON-458967949 None] Created volume successfully. Sep 11 21:32:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3db5cd14-56c7-45ed-82d0-c1c81c54e1e4 tempest-GroupSnapshotsTest-1283956610 None] Update group completed successfully. Sep 11 21:32:18 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5c3bfc15-620c-4519-9b6d-fc4a11104f1b tempest-GroupSnapshotsTest-1283956610 None] Update group completed successfully. Sep 11 21:32:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Creating offline snapshot 4b125255-a767-441b-adc2-e5828bd86eb6 of volume 873ff71c-8ee9-4d42-84af-18a6a09da57b {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:32:19 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d66228c-c832-421e-9709-765110e8ca36]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:19 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b Sep 11 21:32:19 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:19 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b" returned: 0 in 0.598s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:19 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 1G Sep 11 21:32:19 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:20 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 1G" returned: 0 in 0.594s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-873ff71c-8ee9-4d42-84af-18a6a09da57b -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:20 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-873ff71c-8ee9-4d42-84af-18a6a09da57b -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 Sep 11 21:32:20 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:20 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] GroupSnapshot 6af022a5-13e8-4841-9d38-139507744eb2: creating. Sep 11 21:32:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Group snapshot 6af022a5-13e8-4841-9d38-139507744eb2: creating. {{(pid=87423) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 21:32:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:21 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-873ff71c-8ee9-4d42-84af-18a6a09da57b -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6" returned: 0 in 0.720s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:21 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 is being set with open permissions: ugo+rw Sep 11 21:32:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:21 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 Sep 11 21:32:21 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:21 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6" returned: 0 in 0.462s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:21 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.info Sep 11 21:32:21 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:21 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.info" returned: 0 in 0.287s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:21 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.info is being set with open permissions: ugo+rw Sep 11 21:32:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:21 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.info Sep 11 21:32:21 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:22 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.info" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.102s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.673s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Creating offline snapshot df7b9bc2-5df5-4ed9-b896-3a402dc3440d of volume 340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:32:22 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[47822c43-c2c0-4007-8674-7c73f017a4a8]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ba84525e-43aa-47b5-94f4-3d713cf034f8 tempest-VolumesSnapshotTestJSON-458967949 None] Create snapshot completed successfully Sep 11 21:32:22 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 Sep 11 21:32:22 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:22 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" returned: 0 in 0.653s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:23 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d 1G Sep 11 21:32:23 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:23 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d 1G" returned: 0 in 0.772s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:23 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d Sep 11 21:32:23 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-4b125255-a767-441b-adc2-e5828bd86eb6-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-4b125255-a767-441b-adc2-e5828bd86eb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-873ff71c-8ee9-4d42-84af-18a6a09da57b" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-873ff71c-8ee9-4d42-84af-18a6a09da57b" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-4b125255-a767-441b-adc2-e5828bd86eb6" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-4b125255-a767-441b-adc2-e5828bd86eb6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Deleting offline snapshot 4b125255-a767-441b-adc2-e5828bd86eb6 of volume 873ff71c-8ee9-4d42-84af-18a6a09da57b {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] snapshot_file for this snap is: volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[534c3fbc-cb07-46d9-a937-fc942625a689]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:24 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 Sep 11 21:32:24 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:24 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d" returned: 0 in 0.821s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:24 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:24 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d Sep 11 21:32:24 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:24 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6" returned: 0 in 0.635s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-873ff71c-8ee9-4d42-84af-18a6a09da57b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:32:25 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a16de8-7503-4481-bef0-75e7d8dbbed8]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:25 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d" returned: 0 in 0.526s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:25 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b Sep 11 21:32:25 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:25 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.info Sep 11 21:32:25 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:25 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b" returned: 0 in 0.768s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:25 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 Sep 11 21:32:25 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:25 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.info" returned: 0 in 0.801s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:25 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:32:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:26 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.info Sep 11 21:32:26 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:26 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.info" returned: 0 in 0.580s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.324s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Creating offline snapshot e690ca34-b1ab-4a2e-9770-edf6993526e8 of volume 6871ed5a-4be4-4392-b0bf-8f9f37a73e08 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:32:26 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d8c0cb-0e78-4dc4-81f8-e1b42433cd50]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:26 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6" returned: 0 in 0.843s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:26 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6 Sep 11 21:32:26 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:26 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 Sep 11 21:32:26 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:27 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b.4b125255-a767-441b-adc2-e5828bd86eb6" returned: 0 in 0.570s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:27 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" returned: 0 in 0.613s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:27 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 1G Sep 11 21:32:27 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-4b125255-a767-441b-adc2-e5828bd86eb6" released by "_delete_snapshot" :: held 3.103s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-873ff71c-8ee9-4d42-84af-18a6a09da57b" released by "delete_snapshot" :: held 3.153s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:27 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Created reservations ['c8fe9be2-f58e-4221-ae7e-1ac1990ec8ca', '80d8fa27-d4b4-4609-8a83-5f0205b8cebc', '461f9650-cf89-47fa-bebc-8571c6354b18', 'f4fd1fcc-f95a-43e5-8dac-9046331b3f30'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:27 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Delete snapshot completed successfully. Sep 11 21:32:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9e855fe-fc07-4ab7-8cc2-de2799209e46 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-4b125255-a767-441b-adc2-e5828bd86eb6-delete_snapshot" released by "delete_snapshot" :: held 3.611s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:27 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 1G" returned: 0 in 0.722s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:27 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 Sep 11 21:32:27 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:28 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8" returned: 0 in 0.440s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:28 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:32:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:28 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 Sep 11 21:32:28 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:28 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8" returned: 0 in 0.338s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:28 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.info Sep 11 21:32:28 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:29 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.info" returned: 0 in 0.442s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:29 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:29 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.info Sep 11 21:32:29 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:29 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (1a231e96-095b-4966-b08c-202489084dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144e5d22-e390-4db4-bd7e-c7e40a912d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.info" returned: 0 in 0.531s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.223s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144e5d22-e390-4db4-bd7e-c7e40a912d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1870757950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8118505-abff-41e3-a1d0-3e46799d6f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8b8ca97f74c2291b2fa5d8d707b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:30Z,use_quota=True,user_id='bc0920054efd4b7389247d373258ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e27a592-c873-442b-9d2b-6566ca14a208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e27a592-c873-442b-9d2b-6566ca14a208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19d107e-0030-43e2-b5bb-70091c720493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19d107e-0030-43e2-b5bb-70091c720493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8118505-abff-41e3-a1d0-3e46799d6f81', 'volume_name': 'volume-c8118505-abff-41e3-a1d0-3e46799d6f81', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756e1ffd-2b60-41a2-9940-9e607983459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756e1ffd-2b60-41a2-9940-9e607983459e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6127a026-72ea-4202-b41c-22b4f4a343cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:29 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Volume c8118505-abff-41e3-a1d0-3e46799d6f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8118505-abff-41e3-a1d0-3e46799d6f81', 'volume_size': 1} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1870757950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8118505-abff-41e3-a1d0-3e46799d6f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8b8ca97f74c2291b2fa5d8d707b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:30Z,use_quota=True,user_id='bc0920054efd4b7389247d373258ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Creating volume c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:29 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:32:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:29 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 1073741824 Sep 11 21:32:29 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:30 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5a41b83f-9600-4421-a459-acd18ff33119 tempest-GroupSnapshotsTest-1283956610 None] group_snapshot 6af022a5-13e8-4841-9d38-139507744eb2: created successfully Sep 11 21:32:30 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 1073741824" returned: 0 in 0.607s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:30 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 Sep 11 21:32:30 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:30 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] group_snapshot 6af022a5-13e8-4841-9d38-139507744eb2: deleting Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] group_snapshot 6af022a5-13e8-4841-9d38-139507744eb2: deleting {{(pid=87423) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-df7b9bc2-5df5-4ed9-b896-3a402dc3440d" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-df7b9bc2-5df5-4ed9-b896-3a402dc3440d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Deleting offline snapshot df7b9bc2-5df5-4ed9-b896-3a402dc3440d of volume 340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] snapshot_file for this snap is: volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:32:30 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd4934b-6868-4a47-972c-45a4c7f22965]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81" returned: 0 in 0.400s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6127a026-72ea-4202-b41c-22b4f4a343cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8118505-abff-41e3-a1d0-3e46799d6f81', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716868d7-3eb1-4b0a-a9cb-afe3de2a3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:31 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Volume volume-c8118505-abff-41e3-a1d0-3e46799d6f81 (c8118505-abff-41e3-a1d0-3e46799d6f81): created successfully Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716868d7-3eb1-4b0a-a9cb-afe3de2a3956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (1a231e96-095b-4966-b08c-202489084dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-249a8bde-752c-4aa4-87e1-925f7b47aa74 tempest-VolumesSnapshotTestJSON-458967949 None] Created volume successfully. Sep 11 21:32:31 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d Sep 11 21:32:31 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:31 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d" returned: 0 in 0.455s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a01f7-17eb-47ee-b1fa-d9e0ca053f19]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:31 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 Sep 11 21:32:31 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:31 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" returned: 0 in 0.384s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:31 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d Sep 11 21:32:31 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Creating offline snapshot acc002aa-86ed-4f55-bf24-e489d187de97 of volume c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da66685-c3db-40b1-8165-599a6582feec]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:32 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 Sep 11 21:32:32 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:32 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d" returned: 0 in 0.426s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:32 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d Sep 11 21:32:32 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:32 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0.df7b9bc2-5df5-4ed9-b896-3a402dc3440d" returned: 0 in 0.272s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:32 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81" returned: 0 in 0.485s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-df7b9bc2-5df5-4ed9-b896-3a402dc3440d" released by "_delete_snapshot" :: held 1.680s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" released by "delete_snapshot" :: held 1.719s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=92,cinder:UPDATE=75,cinder:DELETE=4,cinder:INSERT=14 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:32:32 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 1G Sep 11 21:32:32 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-e690ca34-b1ab-4a2e-9770-edf6993526e8" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-e690ca34-b1ab-4a2e-9770-edf6993526e8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Deleting offline snapshot e690ca34-b1ab-4a2e-9770-edf6993526e8 of volume 6871ed5a-4be4-4392-b0bf-8f9f37a73e08 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] snapshot_file for this snap is: volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d767498-58f7-469c-a79a-85384ff76c8b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:32 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 Sep 11 21:32:32 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:33 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8" returned: 0 in 0.436s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:32:33 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 1G" returned: 0 in 0.591s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8118505-abff-41e3-a1d0-3e46799d6f81 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fe17ce-a993-4b30-b0e8-7712cd41073c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:33 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8118505-abff-41e3-a1d0-3e46799d6f81 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 Sep 11 21:32:33 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:33 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 Sep 11 21:32:33 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:33 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8118505-abff-41e3-a1d0-3e46799d6f81 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97" returned: 0 in 0.364s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:33 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 is being set with open permissions: ugo+rw Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:33 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 Sep 11 21:32:33 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:33 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" returned: 0 in 0.498s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:33 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 Sep 11 21:32:33 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:33 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97" returned: 0 in 0.310s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=96,cinder:UPDATE=87,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:32:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:33 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.info Sep 11 21:32:33 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:34 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8" returned: 0 in 0.390s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:34 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8 Sep 11 21:32:34 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:34 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.info" returned: 0 in 0.289s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:34 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.info is being set with open permissions: ugo+rw Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:34 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.info Sep 11 21:32:34 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:34 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08.e690ca34-b1ab-4a2e-9770-edf6993526e8" returned: 0 in 0.332s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-e690ca34-b1ab-4a2e-9770-edf6993526e8" released by "_delete_snapshot" :: held 1.783s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" released by "delete_snapshot" :: held 1.824s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:34 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.info" returned: 0 in 0.351s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:34 devstack cinder-volume[87423]: WARNING cinder.quota [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-227765148 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-227765148, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:32:34 devstack cinder-volume[87423]: WARNING cinder.quota [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-227765148 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-227765148, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:32:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c539e753-a619-4fbc-a95e-ce0e74ce0062 tempest-VolumesSnapshotTestJSON-458967949 None] Create snapshot completed successfully Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['69636377-c747-43c2-9fc5-abafc41cb523', 'cc2c86ff-5d5a-41af-a06c-c0c31130ad5b', 'd70b8cbd-5c89-4455-948d-339eeb0baae9', 'b8a92200-7ea1-4d35-949e-e9204b656e28'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:34 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['5bd1437f-c42b-4590-ae18-66e03459662e', '8e4362a7-f211-4f18-a2ab-2f156e02dc9d', '561cfb20-2ac3-4b65-81b1-1d34cd2686c5', 'e51e5e52-2de1-47bf-b3bf-59a221abb2a0'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9ade86ef-cddc-42c8-ab20-c3b0c8bb00c0 tempest-GroupSnapshotsTest-1283956610 None] group_snapshot 6af022a5-13e8-4841-9d38-139507744eb2: deleted successfully Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (0e393f8f-4a2f-488c-aa8c-b5e9c8a454ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fb6063-2cb1-463c-9132-10dae660afd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" acquired by "delete_volume" :: waited 0.042s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fb6063-2cb1-463c-9132-10dae660afd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2088506246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5398bac9-4983-4be0-b207-a9356e89dd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8b8ca97f74c2291b2fa5d8d707b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=acc002aa-86ed-4f55-bf24-e489d187de97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:36Z,use_quota=True,user_id='bc0920054efd4b7389247d373258ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2523cac4-b611-4e26-b185-067267003f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2523cac4-b611-4e26-b185-067267003f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420d20ff-a279-40fe-b7a5-3a136b240ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420d20ff-a279-40fe-b7a5-3a136b240ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5398bac9-4983-4be0-b207-a9356e89dd43', 'volume_name': 'volume-5398bac9-4983-4be0-b207-a9356e89dd43', 'volume_size': 2, 'snapshot_id': 'acc002aa-86ed-4f55-bf24-e489d187de97'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5a32c4-0c50-47d1-933c-0f7319c51b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5a32c4-0c50-47d1-933c-0f7319c51b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b37c06-3e46-4df4-befc-6d8c9e69b077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:35 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Volume 5398bac9-4983-4be0-b207-a9356e89dd43: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5398bac9-4983-4be0-b207-a9356e89dd43', 'volume_size': 2, 'snapshot_id': 'acc002aa-86ed-4f55-bf24-e489d187de97'} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[556a583a-482c-4bc5-b53e-f55a36934fd0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-acc002aa-86ed-4f55-bf24-e489d187de97-5398bac9-4983-4be0-b207-a9356e89dd43" by "_create_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-acc002aa-86ed-4f55-bf24-e489d187de97-5398bac9-4983-4be0-b207-a9356e89dd43" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Creating volume 5398bac9-4983-4be0-b207-a9356e89dd43 from snapshot acc002aa-86ed-4f55-bf24-e489d187de97 {{(pid=87423) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-5398bac9-4983-4be0-b207-a9356e89dd43" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-5398bac9-4983-4be0-b207-a9356e89dd43" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] snapshot: acc002aa-86ed-4f55-bf24-e489d187de97, volume: 5398bac9-4983-4be0-b207-a9356e89dd43, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:32:35 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 Sep 11 21:32:35 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c62c69-4673-45d9-8b6d-a90bd2635fd0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:36 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 Sep 11 21:32:36 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:36 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" returned: 0 in 0.365s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:36 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0 Sep 11 21:32:36 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:36 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97" returned: 0 in 0.369s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8118505-abff-41e3-a1d0-3e46799d6f81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc059e82-610b-4c4d-ad1e-637ce17435b9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:36 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" returned: 0 in 0.247s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:36 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 Sep 11 21:32:36 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-340a5d9b-638c-4bb7-bca9-fdc0f5d99ed0" released by "delete_volume" :: held 0.711s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef02dd-942b-4fee-9f25-aa87cdd05d94]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:36 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 Sep 11 21:32:36 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:36 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81" returned: 0 in 0.392s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:36 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 Sep 11 21:32:36 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:36 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" returned: 0 in 0.398s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:36 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08 Sep 11 21:32:36 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:37 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" returned: 0 in 0.262s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-6871ed5a-4be4-4392-b0bf-8f9f37a73e08" released by "delete_volume" :: held 0.740s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:37 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['35e7e66a-ff4d-43e9-b5a6-28218f223e9a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:37 devstack cinder-volume[87423]: WARNING cinder.quota [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-227765148 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-227765148, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:32:37 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['f9d73977-d41e-4434-a9f4-9cd8368ee4e4', 'c8291db2-68d4-4d3d-a1f2-6aaf1fe4ac07', 'b3a2ad0c-9a41-45c8-859f-0bcbbd75aa7c', 'd4190bcd-ea06-414d-85a4-80f856dd9e6d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:37 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['85ceaeba-b2f6-4893-8d22-2c4a3658c195', '1935f4ad-0b74-43da-b97a-db64bd8034bd', 'fc62c13c-900e-4c13-b9c9-21f0265f9457', 'dd1f285c-507d-42f2-8e46-139baa92edc5'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:38 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:32:38 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:38 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.666s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:38 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:32:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6f28e310-6fa7-4872-9c8d-a6f869f9d7c7 tempest-GroupSnapshotsTest-1283956610 None] Delete group completed successfully. Sep 11 21:32:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c2aabd50-3165-4234-8dce-6b48f84db42d tempest-GroupSnapshotsTest-1283956610 None] Group tempest-GroupSnapshotsTest-Group-964137992: creating Sep 11 21:32:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c2aabd50-3165-4234-8dce-6b48f84db42d tempest-GroupSnapshotsTest-1283956610 None] Group tempest-GroupSnapshotsTest-Group-964137992: created successfully Sep 11 21:32:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c2aabd50-3165-4234-8dce-6b48f84db42d tempest-GroupSnapshotsTest-1283956610 None] Create group completed successfully. Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Flow 'volume_create_manager' (0dbc96d3-3010-4809-8102-3d653d967010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8f655c-3763-435d-bd56-02b5cc2a6a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8f655c-3763-435d-bd56-02b5cc2a6a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-439060387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=247f6a1e-1866-47d8-818f-03848b936022,host='devstack@QuobyteHD#QuobyteHD',id=34b30d36-bd99-4c76-8f5c-b71a41f90536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31d38b769340b58af4b68c3aaec851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:41Z,use_quota=True,user_id='4159830803274e438caa9bf736fd553f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(356aa3d7-7253-4f08-bb6d-496c231cc4eb),volume_type_id=356aa3d7-7253-4f08-bb6d-496c231cc4eb)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ada96d0-9c23-45b7-a0e8-536bbc4e7643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ada96d0-9c23-45b7-a0e8-536bbc4e7643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b83e0d-41d6-471c-a641-fb6eb1de3b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b83e0d-41d6-471c-a641-fb6eb1de3b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b30d36-bd99-4c76-8f5c-b71a41f90536', 'volume_name': 'volume-34b30d36-bd99-4c76-8f5c-b71a41f90536', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837d5c53-9d3f-4efb-ad0d-94146e5d04dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837d5c53-9d3f-4efb-ad0d-94146e5d04dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f83faad-83d8-4d51-8f7f-ee75ad83ec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:41 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Volume 34b30d36-bd99-4c76-8f5c-b71a41f90536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b30d36-bd99-4c76-8f5c-b71a41f90536', 'volume_size': 1} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:41 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43" returned: 0 in 5.139s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:32:41 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Converted 1024.00 MB image at 199.14 MB/s Sep 11 21:32:41 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 is being set with open permissions: ugo+rw Sep 11 21:32:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:41 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 Sep 11 21:32:41 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:42 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43" returned: 0 in 0.312s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-5398bac9-4983-4be0-b207-a9356e89dd43" released by "_copy_volume_from_snapshot" :: held 6.316s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-acc002aa-86ed-4f55-bf24-e489d187de97-5398bac9-4983-4be0-b207-a9356e89dd43" released by "_create_volume_from_snapshot" :: held 6.414s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.431s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=247f6a1e-1866-47d8-818f-03848b936022,created_at=2026-09-11T19:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-439060387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=247f6a1e-1866-47d8-818f-03848b936022,host='devstack@QuobyteHD#QuobyteHD',id=34b30d36-bd99-4c76-8f5c-b71a41f90536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa31d38b769340b58af4b68c3aaec851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:41Z,use_quota=True,user_id='4159830803274e438caa9bf736fd553f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(356aa3d7-7253-4f08-bb6d-496c231cc4eb),volume_type_id=356aa3d7-7253-4f08-bb6d-496c231cc4eb)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Creating volume 34b30d36-bd99-4c76-8f5c-b71a41f90536 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:42 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:42 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 1073741824 Sep 11 21:32:42 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b37c06-3e46-4df4-befc-6d8c9e69b077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5398bac9-4983-4be0-b207-a9356e89dd43', 'volume_size': 2, 'snapshot_id': 'acc002aa-86ed-4f55-bf24-e489d187de97'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c834a88-eb8a-40a6-9f87-6e0d3aec0f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:42 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Volume volume-5398bac9-4983-4be0-b207-a9356e89dd43 (5398bac9-4983-4be0-b207-a9356e89dd43): created successfully Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c834a88-eb8a-40a6-9f87-6e0d3aec0f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (0e393f8f-4a2f-488c-aa8c-b5e9c8a454ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:42 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8e2505ed-190f-4b5b-a3fb-78c396c995fd tempest-VolumesSnapshotTestJSON-458967949 None] Created volume successfully. Sep 11 21:32:42 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 1073741824" returned: 0 in 0.555s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:42 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 Sep 11 21:32:42 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:43 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536" returned: 0 in 0.247s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f83faad-83d8-4d51-8f7f-ee75ad83ec73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b30d36-bd99-4c76-8f5c-b71a41f90536', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eb56cc-2298-422a-ada1-e9360ffc8b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:43 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Volume volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 (34b30d36-bd99-4c76-8f5c-b71a41f90536): created successfully Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eb56cc-2298-422a-ada1-e9360ffc8b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Flow 'volume_create_manager' (0dbc96d3-3010-4809-8102-3d653d967010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:43 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-025db2d4-9839-4aa1-9188-996a52f19cdb tempest-GroupSnapshotsTest-1283956610 None] Created volume successfully. Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-5398bac9-4983-4be0-b207-a9356e89dd43-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-5398bac9-4983-4be0-b207-a9356e89dd43-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-5398bac9-4983-4be0-b207-a9356e89dd43" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-5398bac9-4983-4be0-b207-a9356e89dd43" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2d8286-02a2-4c10-871f-9d8bd3133bb0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:43 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 Sep 11 21:32:43 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:43 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:43 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43 Sep 11 21:32:43 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:44 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5398bac9-4983-4be0-b207-a9356e89dd43" returned: 0 in 0.273s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-5398bac9-4983-4be0-b207-a9356e89dd43" released by "delete_volume" :: held 0.716s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Created reservations ['4e3cc0ab-8c51-490b-a085-23cad7c49602', '7748da25-8fb4-4414-813b-7e5c0aa35995', 'f08c8aad-05c6-4994-9ce2-fea823a078ee', 'ce36836a-7844-498d-939d-d28b1b745809'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] GroupSnapshot afed19d6-653f-45a3-aacb-bcb89134fdde: creating. Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Group snapshot afed19d6-653f-45a3-aacb-bcb89134fdde: creating. {{(pid=87423) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Creating offline snapshot 87edeab4-bdcb-4b8e-81dd-86fc985512be of volume 34b30d36-bd99-4c76-8f5c-b71a41f90536 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fdb255-f04c-4f6f-928e-b429d32ceb38]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:44 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:32:44 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:44 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 Sep 11 21:32:44 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-acc002aa-86ed-4f55-bf24-e489d187de97-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:44 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-acc002aa-86ed-4f55-bf24-e489d187de97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-c8118505-abff-41e3-a1d0-3e46799d6f81" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.348s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:32:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Deleted volume successfully. Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-c8118505-abff-41e3-a1d0-3e46799d6f81" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-acc002aa-86ed-4f55-bf24-e489d187de97" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-acc002aa-86ed-4f55-bf24-e489d187de97" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Deleting offline snapshot acc002aa-86ed-4f55-bf24-e489d187de97 of volume c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] snapshot_file for this snap is: volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfa88470-4ec1-4fdf-8f23-92fd34f087a0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-5398bac9-4983-4be0-b207-a9356e89dd43-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e898ad1-755c-4eae-8667-8e245b82a0d0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:44 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536" returned: 0 in 0.524s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:44 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be 1G Sep 11 21:32:44 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:45 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 Sep 11 21:32:45 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:45 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97" returned: 0 in 0.410s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8118505-abff-41e3-a1d0-3e46799d6f81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:32:45 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c3e429-ebba-4672-989c-44fae78e6732]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:45 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be 1G" returned: 0 in 0.533s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:45 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 Sep 11 21:32:45 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:45 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be Sep 11 21:32:45 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:45 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be" returned: 0 in 0.357s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:45 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:32:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:45 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be Sep 11 21:32:45 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:45 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81" returned: 0 in 0.660s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:46 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 Sep 11 21:32:46 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:46 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:46 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.info Sep 11 21:32:46 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:46 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97" returned: 0 in 0.408s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:46 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-86c055f2-d31e-46a2-8482-2ea72dfe1e10 req-28226dbe-b52c-434f-9fc9-4a405126b932 tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.info" returned: 0 in 0.283s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:46 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:46 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97 Sep 11 21:32:46 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:46 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.info Sep 11 21:32:46 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:46 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81.acc002aa-86ed-4f55-bf24-e489d187de97" returned: 0 in 0.252s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:46 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.info" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-acc002aa-86ed-4f55-bf24-e489d187de97" released by "_delete_snapshot" :: held 1.858s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-86c055f2-d31e-46a2-8482-2ea72dfe1e10 req-28226dbe-b52c-434f-9fc9-4a405126b932 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.293s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-c8118505-abff-41e3-a1d0-3e46799d6f81" released by "delete_snapshot" :: held 1.909s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-86c055f2-d31e-46a2-8482-2ea72dfe1e10 req-28226dbe-b52c-434f-9fc9-4a405126b932 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.074s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-86c055f2-d31e-46a2-8482-2ea72dfe1e10 req-28226dbe-b52c-434f-9fc9-4a405126b932 tempest-TestServerVolumeAttachmentScenario-222870486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33ba45b5-f99e-498a-b61a-7d55f9cc8059', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:32:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-bde3b3d1-7d41-42e8-84fa-eb5e97c4fa9a tempest-GroupSnapshotsTest-1283956610 None] group_snapshot afed19d6-653f-45a3-aacb-bcb89134fdde: created successfully Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Created reservations ['e45bb84a-fc49-4367-a0ab-2b41fa4224d3', 'cdc5fefc-95a8-4135-8670-f97dd385852f', 'd3aa30eb-c531-4364-bf11-944b61081af9', 'afb8e274-ea9d-4aaa-8caf-4a95c997a9f3'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-86c055f2-d31e-46a2-8482-2ea72dfe1e10 req-28226dbe-b52c-434f-9fc9-4a405126b932 tempest-TestServerVolumeAttachmentScenario-222870486 None] attachment_update completed successfully. Sep 11 21:32:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Delete snapshot completed successfully. Sep 11 21:32:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3e874fc6-de0e-487b-a7b2-eb23a572b119 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-acc002aa-86ed-4f55-bf24-e489d187de97-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:47 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] group_snapshot afed19d6-653f-45a3-aacb-bcb89134fdde: deleting Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] group_snapshot afed19d6-653f-45a3-aacb-bcb89134fdde: deleting {{(pid=87423) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-34b30d36-bd99-4c76-8f5c-b71a41f90536" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-34b30d36-bd99-4c76-8f5c-b71a41f90536" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-87edeab4-bdcb-4b8e-81dd-86fc985512be" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-87edeab4-bdcb-4b8e-81dd-86fc985512be" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Deleting offline snapshot 87edeab4-bdcb-4b8e-81dd-86fc985512be of volume 34b30d36-bd99-4c76-8f5c-b71a41f90536 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] snapshot_file for this snap is: volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[967db2a1-e983-4ad4-a1e7-11a9f2ce1e0a]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:47 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be Sep 11 21:32:47 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-c8118505-abff-41e3-a1d0-3e46799d6f81-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-c8118505-abff-41e3-a1d0-3e46799d6f81-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-c8118505-abff-41e3-a1d0-3e46799d6f81" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-c8118505-abff-41e3-a1d0-3e46799d6f81" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db933c-3fd6-4d2c-8512-e4bd882e4ab0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:48 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 Sep 11 21:32:48 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:48 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be" returned: 0 in 0.410s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34b30d36-bd99-4c76-8f5c-b71a41f90536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[295a9ee6-486e-4a59-b44f-6c8f204b0695]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:48 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 Sep 11 21:32:48 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:48 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81" returned: 0 in 0.482s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:48 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81 Sep 11 21:32:48 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:48 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536" returned: 0 in 0.468s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:48 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be Sep 11 21:32:48 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:48 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c8118505-abff-41e3-a1d0-3e46799d6f81" returned: 0 in 0.341s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-c8118505-abff-41e3-a1d0-3e46799d6f81" released by "delete_volume" :: held 0.890s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Created reservations ['05e41151-0a4e-4fce-9377-f1f37a5c7405', 'ffd3893b-a6a2-4597-a605-cce5c0d9b94a', 'bcb6910a-a05a-4fe0-94c2-25d9ccb9e1a3', '91c95d5a-fc93-4bda-be6f-c247665ca77b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:49 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:32:49 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:49 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be" returned: 0 in 0.495s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:49 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be Sep 11 21:32:49 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:49 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.307s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:32:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Deleted volume successfully. Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f064352c-6a52-4560-b9b7-a5d7303849b0 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-c8118505-abff-41e3-a1d0-3e46799d6f81-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:49 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536.87edeab4-bdcb-4b8e-81dd-86fc985512be" returned: 0 in 0.286s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-87edeab4-bdcb-4b8e-81dd-86fc985512be" released by "_delete_snapshot" :: held 1.777s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-34b30d36-bd99-4c76-8f5c-b71a41f90536" released by "delete_snapshot" :: held 1.802s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:49 devstack cinder-volume[87423]: WARNING cinder.quota [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-403088046 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-403088046, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:32:49 devstack cinder-volume[87423]: WARNING cinder.quota [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-403088046 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-403088046, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:32:49 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['c3b645d8-cac5-485f-8133-dd8eae17ee9b', '7997a7bd-5d2e-426a-b72a-dacf416b6b13', '5ef56e78-461a-4530-a271-715033d1dabc', '22a8a8cf-9254-494b-80c6-5cde8c9b0018'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f829f6b6-30aa-4efa-b20f-2746082b37ad tempest-GroupSnapshotsTest-1283956610 None] group_snapshot afed19d6-653f-45a3-aacb-bcb89134fdde: deleted successfully Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (997555e6-55e7-4aa8-8be4-f82cc864761a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca7fe0a-ef74-4deb-bf33-0950191e5fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca7fe0a-ef74-4deb-bf33-0950191e5fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-649412497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42c88d3-f686-4860-8de1-4cf3a2b85af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8b8ca97f74c2291b2fa5d8d707b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:50Z,use_quota=True,user_id='bc0920054efd4b7389247d373258ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87beebb-f5b8-4224-8d49-c69c945b556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87beebb-f5b8-4224-8d49-c69c945b556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdb24c1-60c8-4797-9a51-1b7d10eca95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdb24c1-60c8-4797-9a51-1b7d10eca95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c42c88d3-f686-4860-8de1-4cf3a2b85af5', 'volume_name': 'volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3a7536-f5c1-426c-95bd-7622e8f596ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3a7536-f5c1-426c-95bd-7622e8f596ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69323f8a-ceb8-45cc-b980-ca276df51916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Volume c42c88d3-f686-4860-8de1-4cf3a2b85af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5', 'volume_size': 1} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-649412497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42c88d3-f686-4860-8de1-4cf3a2b85af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8b8ca97f74c2291b2fa5d8d707b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:50Z,use_quota=True,user_id='bc0920054efd4b7389247d373258ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Creating volume c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:50 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:50 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 1073741824 Sep 11 21:32:50 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-bf877972-a10b-44b9-ab6a-2f4b2b776e19 req-88442b88-5172-4313-b3bc-f97e046c4803 tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:50 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 1073741824" returned: 0 in 0.446s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:50 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 Sep 11 21:32:50 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:50 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-bf877972-a10b-44b9-ab6a-2f4b2b776e19 req-88442b88-5172-4313-b3bc-f97e046c4803 tempest-TestStampPattern-1722604090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.720s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69323f8a-ceb8-45cc-b980-ca276df51916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82051cd6-ad57-4b41-8d5c-8cfe72abb0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-bf877972-a10b-44b9-ab6a-2f4b2b776e19 req-88442b88-5172-4313-b3bc-f97e046c4803 tempest-TestStampPattern-1722604090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Volume volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 (c42c88d3-f686-4860-8de1-4cf3a2b85af5): created successfully Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82051cd6-ad57-4b41-8d5c-8cfe72abb0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (997555e6-55e7-4aa8-8be4-f82cc864761a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2eddfdd7-5730-4da9-98fa-3d89e247915b tempest-VolumesSnapshotTestJSON-458967949 None] Created volume successfully. Sep 11 21:32:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-bf877972-a10b-44b9-ab6a-2f4b2b776e19 req-88442b88-5172-4313-b3bc-f97e046c4803 tempest-TestStampPattern-1722604090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-e1645230-1a9d-43e9-bc38-b848ad35c130', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7700434d-7096-4cf0-84fa-d96deedeb63f', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "cinder-quobyte-34b30d36-bd99-4c76-8f5c-b71a41f90536" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-34b30d36-bd99-4c76-8f5c-b71a41f90536" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:51 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-bf877972-a10b-44b9-ab6a-2f4b2b776e19 req-88442b88-5172-4313-b3bc-f97e046c4803 tempest-TestStampPattern-1722604090 None] attachment_update completed successfully. Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[77577de5-b245-4a1c-9c56-848ab3b20182]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:51 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 Sep 11 21:32:51 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Creating offline snapshot 734d32b7-ad13-46bc-aa13-bfef0601b9d1 of volume c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[86701e2a-ac1b-45db-8312-0cd47bdccdeb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:51 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536" returned: 0 in 0.603s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:51 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 Sep 11 21:32:51 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:51 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536 Sep 11 21:32:51 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:52 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-34b30d36-bd99-4c76-8f5c-b71a41f90536" returned: 0 in 0.317s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:52 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Lock "cinder-quobyte-34b30d36-bd99-4c76-8f5c-b71a41f90536" released by "delete_volume" :: held 1.010s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5" returned: 0 in 0.516s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:52 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 1G Sep 11 21:32:52 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['655d1bfc-a012-4459-b5ff-76ab516d142b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:52 devstack cinder-volume[87423]: WARNING cinder.quota [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-403088046 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-403088046, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Created reservations ['241f1d63-83e9-43a4-95ee-65af678084bf', '2059bce0-de2b-4266-87f1-4dfa9e03d901', '895d3bc9-8606-46ae-8340-d771b58c336d', '412456d2-f438-4f76-84f0-a6a25b13c2a8'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-0f4fd69f-08cf-4ddb-a281-2d1944a1c389 req-bcd257e0-0799-46a9-ba27-5523b7481e0f tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:52 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:32:52 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:52 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 1G" returned: 0 in 0.591s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:52 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:32:52 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-78e495b7-efa5-45fb-acca-b633453329af tempest-GroupSnapshotsTest-1283956610 None] Delete group completed successfully. Sep 11 21:32:52 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 Sep 11 21:32:52 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:52 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1" returned: 0 in 0.299s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:52 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 is being set with open permissions: ugo+rw Sep 11 21:32:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:52 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 Sep 11 21:32:52 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:53 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1" returned: 0 in 0.264s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:53 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.info Sep 11 21:32:53 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:53 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.info" returned: 0 in 0.268s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:53 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.info is being set with open permissions: ugo+rw Sep 11 21:32:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:53 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.info Sep 11 21:32:53 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:53 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.info" returned: 0 in 0.273s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-0f4fd69f-08cf-4ddb-a281-2d1944a1c389 req-bcd257e0-0799-46a9-ba27-5523b7481e0f tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.471s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-0f4fd69f-08cf-4ddb-a281-2d1944a1c389 req-bcd257e0-0799-46a9-ba27-5523b7481e0f tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:53 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0f5ea89b-a8e6-495d-ae8d-1ca836f85113 tempest-VolumesSnapshotTestJSON-458967949 None] Create snapshot completed successfully Sep 11 21:32:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-0f4fd69f-08cf-4ddb-a281-2d1944a1c389 req-bcd257e0-0799-46a9-ba27-5523b7481e0f tempest-TestServerVolumeAttachmentScenario-222870486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-74c6850d-699f-4a97-8cbd-112da5b1c971', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62418f98-d185-43d5-bb89-baee0ddf3db3', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:32:53 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-0f4fd69f-08cf-4ddb-a281-2d1944a1c389 req-bcd257e0-0799-46a9-ba27-5523b7481e0f tempest-TestServerVolumeAttachmentScenario-222870486 None] attachment_update completed successfully. Sep 11 21:32:55 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-5b598cb9-4601-470f-81d4-b34d53c368ca req-1401111f-8f92-4d3f-8293-f5c5f0068c88 tempest-TestStampPattern-1722604090 None] Terminate volume connection completed successfully. Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-5b598cb9-4601-470f-81d4-b34d53c368ca req-1401111f-8f92-4d3f-8293-f5c5f0068c88 tempest-TestStampPattern-1722604090 None] Deleting attachment 7700434d-7096-4cf0-84fa-d96deedeb63f. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (f3bd5887-f2c4-4a9d-830b-4db3289cdf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7a2397-ec1b-45a4-8329-8b923b017ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7a2397-ec1b-45a4-8329-8b923b017ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2068401489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc21ec2-ef82-49fe-9cc4-432ea357d343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8b8ca97f74c2291b2fa5d8d707b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=734d32b7-ad13-46bc-aa13-bfef0601b9d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:32:55Z,use_quota=True,user_id='bc0920054efd4b7389247d373258ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc59b61b-2c64-49bb-8d14-6c8db939c6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc59b61b-2c64-49bb-8d14-6c8db939c6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6adc02-895d-4931-bd7a-84818ae154f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6adc02-895d-4931-bd7a-84818ae154f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecc21ec2-ef82-49fe-9cc4-432ea357d343', 'volume_name': 'volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343', 'volume_size': 1, 'snapshot_id': '734d32b7-ad13-46bc-aa13-bfef0601b9d1'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f7ecf9-cf35-4026-9a13-68afa8e6e6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f7ecf9-cf35-4026-9a13-68afa8e6e6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3e8316-99df-4bca-8613-1e600a707d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:32:55 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Volume ecc21ec2-ef82-49fe-9cc4-432ea357d343: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343', 'volume_size': 1, 'snapshot_id': '734d32b7-ad13-46bc-aa13-bfef0601b9d1'} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-734d32b7-ad13-46bc-aa13-bfef0601b9d1-ecc21ec2-ef82-49fe-9cc4-432ea357d343" by "_create_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-734d32b7-ad13-46bc-aa13-bfef0601b9d1-ecc21ec2-ef82-49fe-9cc4-432ea357d343" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Creating volume ecc21ec2-ef82-49fe-9cc4-432ea357d343 from snapshot 734d32b7-ad13-46bc-aa13-bfef0601b9d1 {{(pid=87423) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-ecc21ec2-ef82-49fe-9cc4-432ea357d343" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-ecc21ec2-ef82-49fe-9cc4-432ea357d343" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] snapshot: 734d32b7-ad13-46bc-aa13-bfef0601b9d1, volume: ecc21ec2-ef82-49fe-9cc4-432ea357d343, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[31285deb-be4d-4426-8aa6-0a4d2d973033]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:55 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 Sep 11 21:32:55 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:56 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1" returned: 0 in 0.516s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[314f9067-4f18-42f4-813b-83a377392baa]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-7201b1b2-85d3-4973-b854-52b0a488baa0 req-a0a71523-da46-4289-a6a0-d8177f5e6b4f tempest-TestServerVolumeAttachmentScenario-222870486 None] Terminate volume connection completed successfully. Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-7201b1b2-85d3-4973-b854-52b0a488baa0 req-a0a71523-da46-4289-a6a0-d8177f5e6b4f tempest-TestServerVolumeAttachmentScenario-222870486 None] Deleting attachment 62418f98-d185-43d5-bb89-baee0ddf3db3. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:32:56 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 Sep 11 21:32:56 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:56 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5" returned: 0 in 0.473s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:32:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:32:56 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 Sep 11 21:32:56 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:32:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-a673b925-8cec-4721-bfa5-eb9d7b48a207 req-f4f2b59a-e75c-4a3a-8af6-8beaad0635e8 tempest-TestServerVolumeAttachmentScenario-222870486 None] Terminate volume connection completed successfully. Sep 11 21:32:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-a673b925-8cec-4721-bfa5-eb9d7b48a207 req-f4f2b59a-e75c-4a3a-8af6-8beaad0635e8 tempest-TestServerVolumeAttachmentScenario-222870486 None] Deleting attachment 33ba45b5-f99e-498a-b61a-7d55f9cc8059. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:33:02 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343" returned: 0 in 6.068s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:02 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:33:02 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Converted 1024.00 MB image at 168.71 MB/s Sep 11 21:33:02 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 is being set with open permissions: ugo+rw Sep 11 21:33:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:02 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 Sep 11 21:33:02 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:03 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-ecc21ec2-ef82-49fe-9cc4-432ea357d343" released by "_copy_volume_from_snapshot" :: held 7.423s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-734d32b7-ad13-46bc-aa13-bfef0601b9d1-ecc21ec2-ef82-49fe-9cc4-432ea357d343" released by "_create_volume_from_snapshot" :: held 7.516s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.536s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.777s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Creating offline snapshot b4e65a44-0240-44ac-9931-cd5c575050b1 of volume e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3e8316-99df-4bca-8613-1e600a707d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343', 'volume_size': 1, 'snapshot_id': '734d32b7-ad13-46bc-aa13-bfef0601b9d1'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca06164e-d578-4fee-a16f-8f56e74e4a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4ba11d-e003-4756-8191-8653ca03968c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:03 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Volume volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 (ecc21ec2-ef82-49fe-9cc4-432ea357d343): created successfully Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca06164e-d578-4fee-a16f-8f56e74e4a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Flow 'volume_create_manager' (f3bd5887-f2c4-4a9d-830b-4db3289cdf3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:33:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fa93a7b0-7ea7-46c5-961b-fc0fc778ccd6 tempest-VolumesSnapshotTestJSON-458967949 None] Created volume successfully. Sep 11 21:33:03 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 Sep 11 21:33:03 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-ecc21ec2-ef82-49fe-9cc4-432ea357d343-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-ecc21ec2-ef82-49fe-9cc4-432ea357d343-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:03 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130" returned: 0 in 0.520s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:03 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 1G Sep 11 21:33:03 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-ecc21ec2-ef82-49fe-9cc4-432ea357d343" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-ecc21ec2-ef82-49fe-9cc4-432ea357d343" acquired by "delete_volume" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3d0358-209a-4999-b38f-2c708cdbf9f2]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:04 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 Sep 11 21:33:04 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:04 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 1G" returned: 0 in 0.572s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1645230-1a9d-43e9-bc38-b848ad35c130 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-93209378-a4a3-4041-bf82-f5a797312779 tempest-GroupSnapshotsV319Test-19315872 None] Group tempest-GroupSnapshotsV319Test-Group-1438199232: creating Sep 11 21:33:04 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:04 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1645230-1a9d-43e9-bc38-b848ad35c130 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 Sep 11 21:33:04 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343" returned: 0 in 0.468s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:04 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343 Sep 11 21:33:04 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-93209378-a4a3-4041-bf82-f5a797312779 tempest-GroupSnapshotsV319Test-19315872 None] Group tempest-GroupSnapshotsV319Test-Group-1438199232: created successfully Sep 11 21:33:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-93209378-a4a3-4041-bf82-f5a797312779 tempest-GroupSnapshotsV319Test-19315872 None] Create group completed successfully. Sep 11 21:33:04 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ecc21ec2-ef82-49fe-9cc4-432ea357d343" returned: 0 in 0.259s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:04 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-ecc21ec2-ef82-49fe-9cc4-432ea357d343" released by "delete_volume" :: held 0.784s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1645230-1a9d-43e9-bc38-b848ad35c130 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1" returned: 0 in 0.311s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:04 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 is being set with open permissions: ugo+rw Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:04 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 Sep 11 21:33:04 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Created reservations ['990ac8d1-7442-4abd-814c-df5b85c79e8b', '32d0bf5f-893e-4cef-8fe4-fff36a3c4841', '32fddfc0-964d-4195-b7f1-62586803ad04', 'fda350c3-a170-4e1e-984c-d409182a2e2f'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:04 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:33:04 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:04 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1" returned: 0 in 0.260s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-734d32b7-ad13-46bc-aa13-bfef0601b9d1-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:04 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.info Sep 11 21:33:04 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-734d32b7-ad13-46bc-aa13-bfef0601b9d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-c42c88d3-f686-4860-8de1-4cf3a2b85af5" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-c42c88d3-f686-4860-8de1-4cf3a2b85af5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-734d32b7-ad13-46bc-aa13-bfef0601b9d1" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-734d32b7-ad13-46bc-aa13-bfef0601b9d1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Deleting offline snapshot 734d32b7-ad13-46bc-aa13-bfef0601b9d1 of volume c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:33:05 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] snapshot_file for this snap is: volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:33:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Deleted volume successfully. Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be47887-2dfc-462c-9f55-3a56aa2574ee]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ae3223cd-ed77-4b06-aea3-b1caee7e43f6 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-ecc21ec2-ef82-49fe-9cc4-432ea357d343-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:05 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 Sep 11 21:33:05 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:05 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.info" returned: 0 in 0.335s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:05 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.info is being set with open permissions: ugo+rw Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:05 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.info Sep 11 21:33:05 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:05 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1" returned: 0 in 0.439s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:33:05 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.info" returned: 0 in 0.284s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c524ae0-3544-4061-87cf-434fafa702f5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-296e9c9e-0edc-4de2-9fe6-a5d2dbd4a4ee tempest-TestStampPattern-1722604090 None] Create snapshot completed successfully Sep 11 21:33:05 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 Sep 11 21:33:05 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "cinder-74c6850d-699f-4a97-8cbd-112da5b1c971-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "cinder-74c6850d-699f-4a97-8cbd-112da5b1c971-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Flow 'volume_create_manager' (35a8be17-da18-4f94-9a91-30b05c9ce970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c8ca68-46db-4e84-b143-13f471d959f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c8ca68-46db-4e84-b143-13f471d959f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1217190103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1645a6fa-2ed6-4a51-8106-1aa4b0f0443a,host='devstack@QuobyteHD#QuobyteHD',id=4cb35e6d-3457-45ff-9aaf-b82e1c012cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c2200575824f93a693cde1da7f0210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:33:06Z,use_quota=True,user_id='f8ce1a4280144327bcc0b312f57cb0ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ea08a95-4cb2-4c35-b2c9-8d6129d3a2a4),volume_type_id=0ea08a95-4cb2-4c35-b2c9-8d6129d3a2a4)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd055e92-0039-4dfe-9a2e-3a16e272e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd055e92-0039-4dfe-9a2e-3a16e272e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934839e0-3597-4584-b2ef-7a2e7d6fe7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:06 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934839e0-3597-4584-b2ef-7a2e7d6fe7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb35e6d-3457-45ff-9aaf-b82e1c012cc8', 'volume_name': 'volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ed9fef-0bbe-4491-9899-5f9eb05599e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ed9fef-0bbe-4491-9899-5f9eb05599e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17d62eb-b95e-4069-a664-5ec9e46099e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:06 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Volume 4cb35e6d-3457-45ff-9aaf-b82e1c012cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8', 'volume_size': 1} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1645a6fa-2ed6-4a51-8106-1aa4b0f0443a,created_at=2026-09-11T19:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1217190103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1645a6fa-2ed6-4a51-8106-1aa4b0f0443a,host='devstack@QuobyteHD#QuobyteHD',id=4cb35e6d-3457-45ff-9aaf-b82e1c012cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c2200575824f93a693cde1da7f0210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:33:06Z,use_quota=True,user_id='f8ce1a4280144327bcc0b312f57cb0ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ea08a95-4cb2-4c35-b2c9-8d6129d3a2a4),volume_type_id=0ea08a95-4cb2-4c35-b2c9-8d6129d3a2a4)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Creating volume 4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:33:06 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5" returned: 0 in 0.694s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:06 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 1073741824 Sep 11 21:33:06 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "cinder-quobyte-74c6850d-699f-4a97-8cbd-112da5b1c971" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:06 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 Sep 11 21:33:06 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "cinder-quobyte-74c6850d-699f-4a97-8cbd-112da5b1c971" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1a0ad7-a3d8-4a99-aaa2-13f4a0346e4d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:06 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971 Sep 11 21:33:06 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:06 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1" returned: 0 in 0.380s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:06 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1 Sep 11 21:33:06 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:06 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971" returned: 0 in 0.408s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:06 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 1073741824" returned: 0 in 0.523s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:06 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971 Sep 11 21:33:06 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:06 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 Sep 11 21:33:06 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:06 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5.734d32b7-ad13-46bc-aa13-bfef0601b9d1" returned: 0 in 0.290s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-734d32b7-ad13-46bc-aa13-bfef0601b9d1" released by "_delete_snapshot" :: held 1.953s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-c42c88d3-f686-4860-8de1-4cf3a2b85af5" released by "delete_snapshot" :: held 1.988s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:07 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-74c6850d-699f-4a97-8cbd-112da5b1c971" returned: 0 in 0.288s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "cinder-quobyte-74c6850d-699f-4a97-8cbd-112da5b1c971" released by "delete_volume" :: held 0.743s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Created reservations ['81dc65a1-18fe-40b0-a6fb-0adcaec34d78', 'a79dd6f3-943a-49c4-a712-424bbe5e07a5', 'c865e973-6c6a-4061-977f-e637dee8e0aa', 'a94e479d-b11b-4d35-8262-d10d4d9e8d89'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:33:07 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" returned: 0 in 0.288s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17d62eb-b95e-4069-a664-5ec9e46099e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fd8fbd-3259-4035-b8c5-36215d59c380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Created reservations ['7c3e2378-4182-4773-a567-5b1e3f27ccef', '6efc5515-9722-419f-bf8e-2e9596c50f94', '685673ac-5896-4f36-87af-c11bfac60f08', 'b13ac1eb-3e9d-4371-8ed4-32b6ab9b4013'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:33:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Volume volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 (4cb35e6d-3457-45ff-9aaf-b82e1c012cc8): created successfully Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fd8fbd-3259-4035-b8c5-36215d59c380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Flow 'volume_create_manager' (35a8be17-da18-4f94-9a91-30b05c9ce970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:33:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a273849c-0dbe-4bf1-b65a-48a3ac8a87dd tempest-GroupSnapshotsV319Test-19315872 None] Created volume successfully. Sep 11 21:33:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Delete snapshot completed successfully. Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-352f884a-73c6-4d11-9143-a77459a355b1 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-734d32b7-ad13-46bc-aa13-bfef0601b9d1-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:07 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:33:07 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-c42c88d3-f686-4860-8de1-4cf3a2b85af5-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-c42c88d3-f686-4860-8de1-4cf3a2b85af5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "cinder-d39b36f2-9cf6-4114-9380-c1e73c555dc5-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-c42c88d3-f686-4860-8de1-4cf3a2b85af5" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "cinder-d39b36f2-9cf6-4114-9380-c1e73c555dc5-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-c42c88d3-f686-4860-8de1-4cf3a2b85af5" acquired by "delete_volume" :: waited 0.053s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce238ad-d802-4f98-84d7-4c16f475ba33]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "cinder-quobyte-d39b36f2-9cf6-4114-9380-c1e73c555dc5" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "cinder-quobyte-d39b36f2-9cf6-4114-9380-c1e73c555dc5" acquired by "delete_volume" :: waited 0.032s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:07 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.477s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1448dd1c-2567-42cc-863d-a048cbef8bf6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Deleted volume successfully. Sep 11 21:33:07 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 Sep 11 21:33:07 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-138267d0-b343-4f12-ab10-c6fde51e5a47 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "cinder-74c6850d-699f-4a97-8cbd-112da5b1c971-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] GroupSnapshot 3297936a-c3d4-4ba8-9e57-e5f5c224db87: creating. Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Group snapshot 3297936a-c3d4-4ba8-9e57-e5f5c224db87: creating. {{(pid=87423) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Creating offline snapshot c6ad7e44-061e-4de8-b8d8-2cb597753b17 of volume 4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:33:07 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 Sep 11 21:33:07 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffd367d-4171-4a8a-ae5c-f0b0db99f50a]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:08 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 Sep 11 21:33:08 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:08 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5" returned: 0 in 0.463s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:08 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5 Sep 11 21:33:08 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:08 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5" returned: 0 in 0.435s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:08 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5 Sep 11 21:33:08 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:08 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" returned: 0 in 0.437s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:08 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:08 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 1G Sep 11 21:33:08 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c42c88d3-f686-4860-8de1-4cf3a2b85af5" returned: 0 in 0.290s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-c42c88d3-f686-4860-8de1-4cf3a2b85af5" released by "delete_volume" :: held 0.853s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:08 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d39b36f2-9cf6-4114-9380-c1e73c555dc5" returned: 0 in 0.297s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "cinder-quobyte-d39b36f2-9cf6-4114-9380-c1e73c555dc5" released by "delete_volume" :: held 0.800s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Created reservations ['c9ee1efb-9874-405a-bee4-cfec51f5e1d5', 'fae193e6-e753-4121-a99c-2ffd56d37ae5', 'fe6d2597-0df7-4bf8-aa3c-cbb4293fdc8c', '763f4e81-e9b5-4da5-ab83-b2a4140d7689'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Created reservations ['044228e0-0b4d-4ef0-b154-a029161bb99d', '70f2ffdb-4d8d-44a3-8d3f-6c894a7343ce', '78d0c848-c1dc-475c-88fd-3add7e41dee8', '2230a649-421c-497a-bd83-cda7e4312fd4'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:08 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:33:08 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:08 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:33:08 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-873ff71c-8ee9-4d42-84af-18a6a09da57b-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-873ff71c-8ee9-4d42-84af-18a6a09da57b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "cinder-quobyte-873ff71c-8ee9-4d42-84af-18a6a09da57b" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-873ff71c-8ee9-4d42-84af-18a6a09da57b" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a8a51e-ebe3-4c3b-a9c3-2d89bbd82749]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:09 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 1G" returned: 0 in 0.674s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:09 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 Sep 11 21:33:09 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:09 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.448s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:33:09 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.372s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:33:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Deleted volume successfully. Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f3d5a381-4c9b-4578-b8f6-b71a83e64219 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-c42c88d3-f686-4860-8de1-4cf3a2b85af5-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Deleted volume successfully. Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-207c30e2-33ad-4691-a61e-7d48e7c3e543 tempest-TestServerVolumeAttachmentScenario-222870486 None] Lock "cinder-d39b36f2-9cf6-4114-9380-c1e73c555dc5-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:09 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b Sep 11 21:33:09 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:09 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17" returned: 0 in 0.331s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:09 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:09 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 Sep 11 21:33:09 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:09 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b" returned: 0 in 0.435s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:09 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b Sep 11 21:33:09 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:09 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17" returned: 0 in 0.292s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:09 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.info Sep 11 21:33:09 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:09 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-873ff71c-8ee9-4d42-84af-18a6a09da57b" returned: 0 in 0.337s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-quobyte-873ff71c-8ee9-4d42-84af-18a6a09da57b" released by "delete_volume" :: held 0.854s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Created reservations ['3a56ee9e-0e29-4cd8-86cc-4d21c40940e0', '3eea8af8-ef4b-4a6d-bbb6-367c5f2fc326', '6b92b9c9-5c36-4022-be69-86e86876dba2', '23731b2e-9d76-435f-92db-a0ae8da2937f'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:09 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.info" returned: 0 in 0.326s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:10 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 21:33:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:10 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:33:10 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:10 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.info Sep 11 21:33:10 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:10 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.349s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:10 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:33:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Deleted volume successfully. Sep 11 21:33:10 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.info" returned: 0 in 0.351s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1aba888f-e23f-4b1d-8ac1-2c0ed028def2 tempest-VolumesSnapshotTestJSON-458967949 None] Lock "cinder-873ff71c-8ee9-4d42-84af-18a6a09da57b-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3fab76bc-9d22-4090-9d5d-6342614603e8 tempest-GroupSnapshotsV319Test-19315872 None] group_snapshot 3297936a-c3d4-4ba8-9e57-e5f5c224db87: created successfully Sep 11 21:33:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] group_snapshot 3297936a-c3d4-4ba8-9e57-e5f5c224db87: deleting Sep 11 21:33:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] group_snapshot 3297936a-c3d4-4ba8-9e57-e5f5c224db87: deleting {{(pid=87423) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 21:33:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Acquiring lock "cinder-quobyte-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Lock "cinder-quobyte-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Acquiring lock "cinder-quobyte-c6ad7e44-061e-4de8-b8d8-2cb597753b17" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Lock "cinder-quobyte-c6ad7e44-061e-4de8-b8d8-2cb597753b17" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Deleting offline snapshot c6ad7e44-061e-4de8-b8d8-2cb597753b17 of volume 4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:33:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] snapshot_file for this snap is: volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:33:11 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[923c6ad3-be75-43c7-8d8c-68ef7a28428d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:12 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 Sep 11 21:33:12 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:12 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17" returned: 0 in 0.499s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:33:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cd1ce1-4a5b-4e60-8996-488b8b8e6155]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:12 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 Sep 11 21:33:12 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:12 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" returned: 0 in 0.510s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:13 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 Sep 11 21:33:13 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:13 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17" returned: 0 in 0.423s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:13 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17 Sep 11 21:33:13 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:13 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8.c6ad7e44-061e-4de8-b8d8-2cb597753b17" returned: 0 in 0.309s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Lock "cinder-quobyte-c6ad7e44-061e-4de8-b8d8-2cb597753b17" released by "_delete_snapshot" :: held 1.888s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Lock "cinder-quobyte-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" released by "delete_snapshot" :: held 1.924s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:13 devstack cinder-volume[87423]: WARNING cinder.quota [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-783989688 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-783989688, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:33:13 devstack cinder-volume[87423]: WARNING cinder.quota [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-783989688 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-783989688, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:33:13 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] Created reservations ['87c92297-322d-46a5-a2e4-67344128c1fc', '49540e0c-dac4-496d-bd8f-2e7d09b0a909', 'db747888-e893-41bb-99d7-51b2bbdf0504', 'e0219dab-97cb-4b0a-af46-5c1a67d30378'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:33:13 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b0775849-95c6-4556-85b1-a3dab48f63db tempest-GroupSnapshotsV319Test-19315872 None] group_snapshot 3297936a-c3d4-4ba8-9e57-e5f5c224db87: deleted successfully Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Acquiring lock "cinder-quobyte-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Flow 'volume_create_manager' (14a182ed-028a-4a28-a90d-2f09d42fb87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c65f0a3-eb9c-4f27-9d0d-2aa5e4a30fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Lock "cinder-quobyte-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" acquired by "delete_volume" :: waited 0.068s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c65f0a3-eb9c-4f27-9d0d-2aa5e4a30fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-308941673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c56c855-fb27-4e5d-af72-05ea72ff650d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bb5e4db9ca4a02be56f9f88332fe9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b4e65a44-0240-44ac-9931-cd5c575050b1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:33:14Z,use_quota=True,user_id='98272b883a1c4953bc26cbe73c858c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4508f0-89a3-43ba-bf5e-d44bb39e45e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4508f0-89a3-43ba-bf5e-d44bb39e45e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ddcd70-ce40-431c-b9d4-55b9caf95214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ddcd70-ce40-431c-b9d4-55b9caf95214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c56c855-fb27-4e5d-af72-05ea72ff650d', 'volume_name': 'volume-7c56c855-fb27-4e5d-af72-05ea72ff650d', 'volume_size': 1, 'snapshot_id': 'b4e65a44-0240-44ac-9931-cd5c575050b1'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898b8f19-5e01-4611-a426-4b6f723ed2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898b8f19-5e01-4611-a426-4b6f723ed2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bb6db7-821f-4627-a3a4-8a0ab145f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:14 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Volume 7c56c855-fb27-4e5d-af72-05ea72ff650d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c56c855-fb27-4e5d-af72-05ea72ff650d', 'volume_size': 1, 'snapshot_id': 'b4e65a44-0240-44ac-9931-cd5c575050b1'} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[58eaa704-d7d7-49fb-8f7a-77a08d31d1f5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Acquiring lock "cinder-quobyte-b4e65a44-0240-44ac-9931-cd5c575050b1-7c56c855-fb27-4e5d-af72-05ea72ff650d" by "_create_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-b4e65a44-0240-44ac-9931-cd5c575050b1-7c56c855-fb27-4e5d-af72-05ea72ff650d" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Creating volume 7c56c855-fb27-4e5d-af72-05ea72ff650d from snapshot b4e65a44-0240-44ac-9931-cd5c575050b1 {{(pid=87423) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Acquiring lock "cinder-quobyte-7c56c855-fb27-4e5d-af72-05ea72ff650d" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-7c56c855-fb27-4e5d-af72-05ea72ff650d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] snapshot: b4e65a44-0240-44ac-9931-cd5c575050b1, volume: 7c56c855-fb27-4e5d-af72-05ea72ff650d, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:14 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 Sep 11 21:33:14 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ed8e1d-99b1-4cb2-8984-97b9d5ee658d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:15 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 Sep 11 21:33:15 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:15 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" returned: 0 in 0.500s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:15 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8 Sep 11 21:33:15 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:15 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1" returned: 0 in 0.560s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1645230-1a9d-43e9-bc38-b848ad35c130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[af379a72-1829-42a0-ac29-77fd2400d923]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:15 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" returned: 0 in 0.394s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Lock "cinder-quobyte-4cb35e6d-3457-45ff-9aaf-b82e1c012cc8" released by "delete_volume" :: held 1.058s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:15 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 Sep 11 21:33:15 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Created reservations ['d021b0fb-4324-4057-a7b1-4d73bf416c6c'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:33:15 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:33:15 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:15 devstack cinder-volume[87423]: WARNING cinder.quota [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-783989688 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-783989688, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:33:15 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Created reservations ['51c7488c-a290-4f2f-b3c2-75e0051f8417', 'cda198b3-ad11-4464-b942-8e9b8726a5ce', '1efc6527-14d4-4d71-8550-d26a2addefc2', '976afeb3-accc-4265-af9d-81da89830a7a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:33:16 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130" returned: 0 in 0.631s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:16 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d Sep 11 21:33:16 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:16 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:33:16 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:16 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.449s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:33:16 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.305s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:33:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2048ede2-94e3-4709-8085-598dfa9b8f98 tempest-GroupSnapshotsV319Test-19315872 None] Delete group completed successfully. Sep 11 21:33:23 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d" returned: 0 in 6.932s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:33:23 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Converted 1024.00 MB image at 147.66 MB/s Sep 11 21:33:23 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d is being set with open permissions: ugo+rw Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:23 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d Sep 11 21:33:23 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:23 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d" returned: 0 in 0.311s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-7c56c855-fb27-4e5d-af72-05ea72ff650d" released by "_copy_volume_from_snapshot" :: held 8.584s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-b4e65a44-0240-44ac-9931-cd5c575050b1-7c56c855-fb27-4e5d-af72-05ea72ff650d" released by "_create_volume_from_snapshot" :: held 8.680s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.708s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bb6db7-821f-4627-a3a4-8a0ab145f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c56c855-fb27-4e5d-af72-05ea72ff650d', 'volume_size': 1, 'snapshot_id': 'b4e65a44-0240-44ac-9931-cd5c575050b1'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9206eb46-c462-4f1f-aa61-0bac2bbc5014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:23 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Volume volume-7c56c855-fb27-4e5d-af72-05ea72ff650d (7c56c855-fb27-4e5d-af72-05ea72ff650d): created successfully Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9206eb46-c462-4f1f-aa61-0bac2bbc5014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Flow 'volume_create_manager' (14a182ed-028a-4a28-a90d-2f09d42fb87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:33:23 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f8ad798e-c40a-4573-90d6-2516b8b928a6 tempest-TestStampPattern-1722604090 None] Created volume successfully. Sep 11 21:33:33 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=162,cinder:SELECT=162,cinder:DELETE=5,cinder:INSERT=46 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:33:33 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=162,cinder:UPDATE=168,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Flow 'volume_create_manager' (167d6b27-3154-4900-abb3-c51419b4a063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d7600f-d37f-46df-97f6-49564c6ea9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d7600f-d37f-46df-97f6-49564c6ea9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1922441298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a997c3-cb63-44f6-bdda-d4228e0ae769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0955594c7c5c465eaeae9cfd3d7896bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:33:58Z,use_quota=True,user_id='84278a6812104870b8861e50b7caecb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800871e9-5550-42a1-9e9a-38dc3c51c31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800871e9-5550-42a1-9e9a-38dc3c51c31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228c5ec7-724b-466b-b55d-39157ce04a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228c5ec7-724b-466b-b55d-39157ce04a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a997c3-cb63-44f6-bdda-d4228e0ae769', 'volume_name': 'volume-38a997c3-cb63-44f6-bdda-d4228e0ae769', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2748bc6-38fe-4de0-8898-f30b616e1208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2748bc6-38fe-4de0-8898-f30b616e1208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72bdb05-356a-4780-9967-546e62fb5820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Volume 38a997c3-cb63-44f6-bdda-d4228e0ae769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a997c3-cb63-44f6-bdda-d4228e0ae769', 'volume_size': 1} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1922441298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a997c3-cb63-44f6-bdda-d4228e0ae769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0955594c7c5c465eaeae9cfd3d7896bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:33:58Z,use_quota=True,user_id='84278a6812104870b8861e50b7caecb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Creating volume 38a997c3-cb63-44f6-bdda-d4228e0ae769 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:33:57 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:33:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:57 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 1073741824 Sep 11 21:33:57 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:58 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 1073741824" returned: 0 in 0.924s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:33:58 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 Sep 11 21:33:58 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:33:59 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 11 21:33:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769" returned: 0 in 0.364s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:33:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:33:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:33:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72bdb05-356a-4780-9967-546e62fb5820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a997c3-cb63-44f6-bdda-d4228e0ae769', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c3863a-9dd2-4e2c-b13f-752c52ffd5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:33:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Volume volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 (38a997c3-cb63-44f6-bdda-d4228e0ae769): created successfully Sep 11 21:33:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c3863a-9dd2-4e2c-b13f-752c52ffd5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:33:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Flow 'volume_create_manager' (167d6b27-3154-4900-abb3-c51419b4a063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:33:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8c748a22-a260-4d35-a7cd-d299232a7019 tempest-TestImageHashVerification-223069346 None] Created volume successfully. Sep 11 21:34:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:01 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0a24f1-de8c-457b-96cb-c221e2b5bdcd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:01 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 Sep 11 21:34:01 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-340e9520-f197-40f0-a497-f993b9bf25a4 req-a2309e5f-fb53-4d07-9539-91c876614f2b tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:02 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769" returned: 0 in 0.581s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:02 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d25aa63-9c15-4aab-abf2-8be7d7513c5c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:02 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 Sep 11 21:34:02 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:02 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769" returned: 0 in 0.662s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 /opt/stack/data/cinder/conversion/38a997c3-cb63-44f6-bdda-d4228e0ae769.temp_image.001fc145-9704-40e1-8292-626ff4a126abwbwje9gl.img {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:02 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 /opt/stack/data/cinder/conversion/38a997c3-cb63-44f6-bdda-d4228e0ae769.temp_image.001fc145-9704-40e1-8292-626ff4a126abwbwje9gl.img Sep 11 21:34:02 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Flow 'volume_create_manager' (489508e7-3a34-4d5a-acdf-0b309b35acab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9c5de3-2ebc-425a-92ff-8e14e5ad1958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9c5de3-2ebc-425a-92ff-8e14e5ad1958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-252562245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7e9b5a-ff67-4792-85cc-6db311a4c104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc5bf7cf1be4d16b9de71c137932c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:04Z,use_quota=True,user_id='e0d956215ef3445086ca1df78d2c43fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0527c5a8-46f4-418e-b31b-b93e9110bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0527c5a8-46f4-418e-b31b-b93e9110bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aefc295-451e-4f59-866f-7760aa2050da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aefc295-451e-4f59-866f-7760aa2050da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7e9b5a-ff67-4792-85cc-6db311a4c104', 'volume_name': 'volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a852b0-5368-48d8-bf40-b8a0d9acea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a852b0-5368-48d8-bf40-b8a0d9acea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa5fb9e-6bdc-46c2-9730-56f66aec0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Volume eb7e9b5a-ff67-4792-85cc-6db311a4c104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104', 'volume_size': 1} Sep 11 21:34:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:07 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 /opt/stack/data/cinder/conversion/38a997c3-cb63-44f6-bdda-d4228e0ae769.temp_image.001fc145-9704-40e1-8292-626ff4a126abwbwje9gl.img" returned: 0 in 5.011s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[995b0ea2-c7b0-4971-ab8b-ae03c0303681]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:08 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 Sep 11 21:34:08 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:08 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769" returned: 0 in 0.614s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:08 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/conversion/38a997c3-cb63-44f6-bdda-d4228e0ae769.temp_image.001fc145-9704-40e1-8292-626ff4a126abwbwje9gl.img {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:34:08 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Converted 1024.00 MB image at 204.31 MB/s Sep 11 21:34:08 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] 001fc145-9704-40e1-8292-626ff4a126ab was raw, no need to convert to raw {{(pid=87423) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Flow 'volume_create_manager' (780d083a-7229-49a4-8122-26374af3a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c362426-ed12-48e7-abfe-3d7ea8b40ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c362426-ed12-48e7-abfe-3d7ea8b40ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-375120521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7806e06f-9f99-42ae-bcba-6191ddbfe7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcce34a66f94c5591a149c0dd8b3b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:09Z,use_quota=True,user_id='2bd2ee6c618d4e62911bb9d9c6152365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaefbb4c-a826-476c-8d13-420935d3717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaefbb4c-a826-476c-8d13-420935d3717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8912f9-8161-42ea-a7ce-d06bb4f6d7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8912f9-8161-42ea-a7ce-d06bb4f6d7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7806e06f-9f99-42ae-bcba-6191ddbfe7ab', 'volume_name': 'volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c79248-1961-4ed5-896e-e98e0a24e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c79248-1961-4ed5-896e-e98e0a24e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b798e29-38c0-4b9c-9a91-524560045de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:09 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Volume 7806e06f-9f99-42ae-bcba-6191ddbfe7ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Trying to clone 7806e06f-9f99-42ae-bcba-6191ddbfe7ab from image 8333088b-528a-4438-98ec-37d49b129d98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:34:09 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Image download 20.69 MB at 20.69 MB/s Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bb8149-2e71-4618-9516-0d0a34843fbe]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:09 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD Sep 11 21:34:09 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:10 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:10 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 is fetched for user 2bd2ee6c618d4e62911bb9d9c6152365. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:34:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d236df-4c41-4772-9aaa-52c27051b7cd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:10 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD Sep 11 21:34:10 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:10 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:34:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:15 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:34:15 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:16 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.250s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:34:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:34:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:34:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:34:20 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:34:20 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.176s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Uploaded volume to glance image-id: 001fc145-9704-40e1-8292-626ff4a126ab. {{(pid=87423) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-340e9520-f197-40f0-a497-f993b9bf25a4 req-a2309e5f-fb53-4d07-9539-91c876614f2b tempest-TestStampPattern-1722604090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.609s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-340e9520-f197-40f0-a497-f993b9bf25a4 req-a2309e5f-fb53-4d07-9539-91c876614f2b tempest-TestStampPattern-1722604090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-252562245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7e9b5a-ff67-4792-85cc-6db311a4c104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc5bf7cf1be4d16b9de71c137932c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:04Z,use_quota=True,user_id='e0d956215ef3445086ca1df78d2c43fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Creating volume eb7e9b5a-ff67-4792-85cc-6db311a4c104 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:34:27 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:27 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8673569a-2771-4f33-be24-b90e7fde3e84 tempest-TestImageHashVerification-223069346 None] Copy volume to image completed successfully. Sep 11 21:34:27 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 1073741824 Sep 11 21:34:27 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:27 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-340e9520-f197-40f0-a497-f993b9bf25a4 req-a2309e5f-fb53-4d07-9539-91c876614f2b tempest-TestStampPattern-1722604090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-7c56c855-fb27-4e5d-af72-05ea72ff650d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ff071ed-331a-4391-8154-e3bbe4a1ec33', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:34:27 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-340e9520-f197-40f0-a497-f993b9bf25a4 req-a2309e5f-fb53-4d07-9539-91c876614f2b tempest-TestStampPattern-1722604090 None] attachment_update completed successfully. Sep 11 21:34:28 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 1073741824" returned: 0 in 0.561s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:28 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 Sep 11 21:34:28 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:28 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104" returned: 0 in 0.330s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.042s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-375120521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7806e06f-9f99-42ae-bcba-6191ddbfe7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dcce34a66f94c5591a149c0dd8b3b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:09Z,use_quota=True,user_id='2bd2ee6c618d4e62911bb9d9c6152365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Creating volume 7806e06f-9f99-42ae-bcba-6191ddbfe7ab {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:34:28 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:28 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab 1073741824 Sep 11 21:34:28 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa5fb9e-6bdc-46c2-9730-56f66aec0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6283771-59e0-471c-8597-a4ee3bd37eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:28 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Volume volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 (eb7e9b5a-ff67-4792-85cc-6db311a4c104): created successfully Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6283771-59e0-471c-8597-a4ee3bd37eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Flow 'volume_create_manager' (489508e7-3a34-4d5a-acdf-0b309b35acab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:28 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d228fb14-36e2-4bb1-b25d-1461f61574bc tempest-VolumeQuotasAdminTestJSON-297598232 None] Created volume successfully. Sep 11 21:34:29 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab 1073741824" returned: 0 in 0.444s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:29 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab Sep 11 21:34:29 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Acquiring lock "cinder-38a997c3-cb63-44f6-bdda-d4228e0ae769-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Lock "cinder-38a997c3-cb63-44f6-bdda-d4228e0ae769-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Acquiring lock "cinder-quobyte-38a997c3-cb63-44f6-bdda-d4228e0ae769" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Lock "cinder-quobyte-38a997c3-cb63-44f6-bdda-d4228e0ae769" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[945074e6-f46b-4fcf-a8d7-44c9d16a18ea]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:29 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab" returned: 0 in 0.309s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Attempting download of 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume 7806e06f-9f99-42ae-bcba-6191ddbfe7ab. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:34:29 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 Sep 11 21:34:29 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2920326-1c1a-4f4e-a1cf-3f3aed0d0067]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_aslfj3_q {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Acquiring lock "cinder-eb7e9b5a-ff67-4792-85cc-6db311a4c104-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "cinder-eb7e9b5a-ff67-4792-85cc-6db311a4c104-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Acquiring lock "cinder-quobyte-eb7e9b5a-ff67-4792-85cc-6db311a4c104" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:29 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_aslfj3_q Sep 11 21:34:29 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "cinder-quobyte-eb7e9b5a-ff67-4792-85cc-6db311a4c104" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eb638d-88fc-4f30-9a67-e853426407a9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:29 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 Sep 11 21:34:29 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:29 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769" returned: 0 in 0.517s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:30 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769 Sep 11 21:34:30 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:30 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_aslfj3_q" returned: 0 in 0.415s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_aslfj3_q {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:30 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_aslfj3_q Sep 11 21:34:30 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:30 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-38a997c3-cb63-44f6-bdda-d4228e0ae769" returned: 0 in 0.258s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Lock "cinder-quobyte-38a997c3-cb63-44f6-bdda-d4228e0ae769" released by "delete_volume" :: held 0.842s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:30 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104" returned: 0 in 0.451s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:30 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104 Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Created reservations ['4663b3dd-6082-40f1-83a2-44dd8a394d1e', 'c497dcfd-2e29-4255-bbad-a9837dfc18da', '224e549e-91e9-49e9-ab7e-4173fa526f8a', 'b7afd57e-f6b9-4c68-ab0e-d86b17101c2e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:34:30 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:30 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:34:30 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:30 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_aslfj3_q" returned: 1 in 0.450s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_aslfj3_q' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c078137e-1aff-40a9-a064-ae131a16b2a9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:30 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-eb7e9b5a-ff67-4792-85cc-6db311a4c104" returned: 0 in 0.417s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:30 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD Sep 11 21:34:30 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:30 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "cinder-quobyte-eb7e9b5a-ff67-4792-85cc-6db311a4c104" released by "delete_volume" :: held 0.932s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.334s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:34:30 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Deleted volume successfully. Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-fbaf70b5-3c2a-4413-a8d1-24798801f50b tempest-TestImageHashVerification-223069346 None] Lock "cinder-38a997c3-cb63-44f6-bdda-d4228e0ae769-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Created reservations ['66df997f-1f24-4c87-82ec-1e0b6d5499f2', '8fa143c5-bd24-456d-bb78-f0f9d206afc6', '7c98f8c0-b3e9-4d6c-b0f3-e74f805ec410', '9bef1063-6b22-40e7-85f7-adce632dc7b4'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:31 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:34:31 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:31 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD" returned: 0 in 0.525s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] 8333088b-528a-4438-98ec-37d49b129d98 was qcow2, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:31 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab Sep 11 21:34:31 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:31 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.378s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:34:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Deleted volume successfully. Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-32eb42a5-b00b-43c8-829d-d9ac3ec1d52f tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "cinder-eb7e9b5a-ff67-4792-85cc-6db311a4c104-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-0ed09db1-66fe-40ee-8c4c-c2da86e06b38 req-31bd286f-4343-4b48-b75b-4637b9d2ff69 tempest-TestStampPattern-1722604090 None] Terminate volume connection completed successfully. Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-0ed09db1-66fe-40ee-8c4c-c2da86e06b38 req-31bd286f-4343-4b48-b75b-4637b9d2ff69 tempest-TestStampPattern-1722604090 None] Deleting attachment 6ff071ed-331a-4391-8154-e3bbe4a1ec33. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Flow 'volume_create_manager' (55d50f3c-b489-408a-844f-3362c821a0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0816c49-abbc-4389-8c52-7b27717a26aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0816c49-abbc-4389-8c52-7b27717a26aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1945232867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c278e46-53fd-42af-af2c-8944ee687416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc5bf7cf1be4d16b9de71c137932c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:32Z,use_quota=True,user_id='e0d956215ef3445086ca1df78d2c43fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dd723f-00af-4fe7-a073-85d510b96b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dd723f-00af-4fe7-a073-85d510b96b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff3f842-3fe4-4c35-a606-8d61d7ffa278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff3f842-3fe4-4c35-a606-8d61d7ffa278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c278e46-53fd-42af-af2c-8944ee687416', 'volume_name': 'volume-8c278e46-53fd-42af-af2c-8944ee687416', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79d65ad-c0a7-4a54-aac9-7c6f6b271adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79d65ad-c0a7-4a54-aac9-7c6f6b271adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3245bd5a-0e3a-4515-b878-c45befdc1e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:31 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Volume 8c278e46-53fd-42af-af2c-8944ee687416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c278e46-53fd-42af-af2c-8944ee687416', 'volume_size': 1} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1945232867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c278e46-53fd-42af-af2c-8944ee687416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc5bf7cf1be4d16b9de71c137932c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:32Z,use_quota=True,user_id='e0d956215ef3445086ca1df78d2c43fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Creating volume 8c278e46-53fd-42af-af2c-8944ee687416 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:34:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:34:32 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:34:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:32 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416 1073741824 Sep 11 21:34:32 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:32 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416 1073741824" returned: 0 in 0.581s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:32 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416 Sep 11 21:34:32 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:33 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416" returned: 0 in 0.367s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3245bd5a-0e3a-4515-b878-c45befdc1e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c278e46-53fd-42af-af2c-8944ee687416', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1ebd02-ca05-4c03-a1f6-b44bcd011d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:33 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Volume volume-8c278e46-53fd-42af-af2c-8944ee687416 (8c278e46-53fd-42af-af2c-8944ee687416): created successfully Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1ebd02-ca05-4c03-a1f6-b44bcd011d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Flow 'volume_create_manager' (55d50f3c-b489-408a-844f-3362c821a0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:33 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8319ca41-b896-4798-9af7-184f925b48fa tempest-VolumeQuotasAdminTestJSON-297598232 None] Created volume successfully. Sep 11 21:34:33 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab" returned: 0 in 2.415s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_cshwaqs5devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:34:33 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Converted 112.00 MB image at 46.34 MB/s Sep 11 21:34:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:33 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab 1G Sep 11 21:34:33 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:34 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab 1G" returned: 0 in 0.635s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Downloaded image 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume 7806e06f-9f99-42ae-bcba-6191ddbfe7ab successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 for user 2bd2ee6c618d4e62911bb9d9c6152365 is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Marking volume 7806e06f-9f99-42ae-bcba-6191ddbfe7ab as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Copying metadata from image 8333088b-528a-4438-98ec-37d49b129d98 to 7806e06f-9f99-42ae-bcba-6191ddbfe7ab. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Creating volume glance metadata for volume 7806e06f-9f99-42ae-bcba-6191ddbfe7ab backed by image 8333088b-528a-4438-98ec-37d49b129d98 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b798e29-38c0-4b9c-9a91-524560045de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9f3f7f-b982-4d27-8055-b1f8cbed7a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:34 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Volume volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab (7806e06f-9f99-42ae-bcba-6191ddbfe7ab): created successfully Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9f3f7f-b982-4d27-8055-b1f8cbed7a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Flow 'volume_create_manager' (780d083a-7229-49a4-8122-26374af3a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0501e989-e071-4e71-b0fe-315f25def9e7 tempest-TestShelveInstance-1274408701 None] Created volume successfully. Sep 11 21:34:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-113b5003-61f6-4833-91eb-75ab51ce8a0e tempest-VolumeQuotasAdminTestJSON-1172421259 None] Transfer volume completed successfully. Sep 11 21:34:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Acquiring lock "cinder-8c278e46-53fd-42af-af2c-8944ee687416-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Lock "cinder-8c278e46-53fd-42af-af2c-8944ee687416-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Acquiring lock "cinder-quobyte-8c278e46-53fd-42af-af2c-8944ee687416" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Lock "cinder-quobyte-8c278e46-53fd-42af-af2c-8944ee687416" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:35 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f35f317-b939-41c5-a969-93ae5b2b0321]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:35 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416 Sep 11 21:34:35 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:36 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416" returned: 0 in 0.499s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:36 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416 Sep 11 21:34:36 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:36 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8c278e46-53fd-42af-af2c-8944ee687416" returned: 0 in 0.264s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Lock "cinder-quobyte-8c278e46-53fd-42af-af2c-8944ee687416" released by "delete_volume" :: held 0.825s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Created reservations ['dd4b1fd9-a09c-423b-acee-abf65ddd1c27', 'bdb6d28c-4464-46b0-b70e-231e8e83c1a5', '19a26065-44f9-4b20-a097-67a046e229e2', 'feca3af3-7a6b-4c8d-af5d-fe939cefe7f9'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:36 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:34:36 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Acquiring lock "cinder-7c56c855-fb27-4e5d-af72-05ea72ff650d-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Lock "cinder-7c56c855-fb27-4e5d-af72-05ea72ff650d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:37 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.499s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:34:37 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Deleted volume successfully. Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Acquiring lock "cinder-quobyte-7c56c855-fb27-4e5d-af72-05ea72ff650d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0794a5f6-27d2-41bc-a407-9427d0c4835b tempest-VolumeQuotasAdminTestJSON-1370814783 None] Lock "cinder-8c278e46-53fd-42af-af2c-8944ee687416-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-7c56c855-fb27-4e5d-af72-05ea72ff650d" acquired by "delete_volume" :: waited 0.040s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88a3057-76dd-4c20-b1fd-3321d4da8df6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:37 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d Sep 11 21:34:37 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:37 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d" returned: 0 in 0.495s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:37 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d Sep 11 21:34:37 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:38 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7c56c855-fb27-4e5d-af72-05ea72ff650d" returned: 0 in 0.362s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-7c56c855-fb27-4e5d-af72-05ea72ff650d" released by "delete_volume" :: held 0.921s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Created reservations ['f973e962-75d1-4893-822d-170e14dc52aa', '2086afb2-a265-488b-ab19-bd6235f26edd', '6cba7bcc-b892-4c50-adcf-3bc8327c8f63', '4b481814-fe1b-44eb-9725-5c27d0efab68'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:38 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:34:38 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:38 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.417s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:34:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Deleted volume successfully. Sep 11 21:34:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-944c88f0-ba0e-4450-abfe-1b6ded3def01 tempest-TestStampPattern-1722604090 None] Lock "cinder-7c56c855-fb27-4e5d-af72-05ea72ff650d-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-49fe8a7a-ad24-475f-8f6e-180853239a8c req-268f6fca-5c79-4184-b5de-54eca8e54f78 tempest-TestShelveInstance-1274408701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-49fe8a7a-ad24-475f-8f6e-180853239a8c req-268f6fca-5c79-4184-b5de-54eca8e54f78 tempest-TestShelveInstance-1274408701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-49fe8a7a-ad24-475f-8f6e-180853239a8c req-268f6fca-5c79-4184-b5de-54eca8e54f78 tempest-TestShelveInstance-1274408701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-49fe8a7a-ad24-475f-8f6e-180853239a8c req-268f6fca-5c79-4184-b5de-54eca8e54f78 tempest-TestShelveInstance-1274408701 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e2e8436-44e8-421f-b740-cf7ba4d4fcc4', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:34:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-49fe8a7a-ad24-475f-8f6e-180853239a8c req-268f6fca-5c79-4184-b5de-54eca8e54f78 tempest-TestShelveInstance-1274408701 None] attachment_update completed successfully. Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Acquiring lock "cinder-b4e65a44-0240-44ac-9931-cd5c575050b1-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Lock "cinder-b4e65a44-0240-44ac-9931-cd5c575050b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Acquiring lock "cinder-quobyte-e1645230-1a9d-43e9-bc38-b848ad35c130" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-e1645230-1a9d-43e9-bc38-b848ad35c130" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Acquiring lock "cinder-quobyte-b4e65a44-0240-44ac-9931-cd5c575050b1" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-b4e65a44-0240-44ac-9931-cd5c575050b1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Deleting offline snapshot b4e65a44-0240-44ac-9931-cd5c575050b1 of volume e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] snapshot_file for this snap is: volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb04aad-05c9-4830-8a80-02f1265159a0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:40 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 Sep 11 21:34:40 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:40 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1" returned: 0 in 0.427s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1645230-1a9d-43e9-bc38-b848ad35c130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:34:40 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[152b9a3d-3165-44f6-b3be-e735368abe95]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:40 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 Sep 11 21:34:40 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:41 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130" returned: 0 in 0.551s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:41 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 Sep 11 21:34:41 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:41 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1" returned: 0 in 0.354s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:41 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1 Sep 11 21:34:41 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:41 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130.b4e65a44-0240-44ac-9931-cd5c575050b1" returned: 0 in 0.268s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-b4e65a44-0240-44ac-9931-cd5c575050b1" released by "_delete_snapshot" :: held 1.787s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-e1645230-1a9d-43e9-bc38-b848ad35c130" released by "delete_snapshot" :: held 1.816s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:41 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Created reservations ['cd62d96e-fea6-44bc-b3e6-8051e4e1a2a4', '3d79e408-18b2-4aad-a3fb-d87de35fb09f', '9b961978-93f7-45dd-9113-7cb60a46a6df', 'f7bd00f6-e650-4854-83de-b6c8f7d48e79'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:34:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Delete snapshot completed successfully. Sep 11 21:34:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dab4181b-a7dc-424c-ac9f-d5ba8883a472 tempest-TestStampPattern-1722604090 None] Lock "cinder-b4e65a44-0240-44ac-9931-cd5c575050b1-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Acquiring lock "cinder-e1645230-1a9d-43e9-bc38-b848ad35c130-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Lock "cinder-e1645230-1a9d-43e9-bc38-b848ad35c130-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Acquiring lock "cinder-quobyte-e1645230-1a9d-43e9-bc38-b848ad35c130" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:34:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-e1645230-1a9d-43e9-bc38-b848ad35c130" acquired by "delete_volume" :: waited 0.050s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:34:48 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3016e922-5711-4701-9fd5-569135015d25]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:34:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:49 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 Sep 11 21:34:49 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:49 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130" returned: 0 in 0.963s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:49 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130 Sep 11 21:34:49 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:50 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e1645230-1a9d-43e9-bc38-b848ad35c130" returned: 0 in 0.481s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Lock "cinder-quobyte-e1645230-1a9d-43e9-bc38-b848ad35c130" released by "delete_volume" :: held 1.613s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Created reservations ['927e6ec7-c870-4a27-9469-598827c0937d', '29376882-592b-420b-a5c8-2bbad2bd5754', '7dba54a8-dbf0-40c8-9f19-d759816b3ff1', '688ec6db-cc82-4269-aea7-6f6a55fc226f'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:50 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:34:50 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:50 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.343s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:34:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Deleted volume successfully. Sep 11 21:34:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2106428f-b659-4fee-ab47-ed1bd3265b43 tempest-TestStampPattern-1722604090 None] Lock "cinder-e1645230-1a9d-43e9-bc38-b848ad35c130-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (30affdf7-2bb0-4297-8287-8a29a376e019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fe5399-a2e8-4005-b4d2-642a9aae47de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fe5399-a2e8-4005-b4d2-642a9aae47de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2010207465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568de521-7614-44a1-89c8-3355d7e0d4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:53Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558008c5-df83-498b-883d-d5de035b07d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558008c5-df83-498b-883d-d5de035b07d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5efd9b1-4d28-4e41-bf27-20bbaea9a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5efd9b1-4d28-4e41-bf27-20bbaea9a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568de521-7614-44a1-89c8-3355d7e0d4a2', 'volume_name': 'volume-568de521-7614-44a1-89c8-3355d7e0d4a2', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35a70b6-4d28-4128-a6e3-e0c794e0e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35a70b6-4d28-4128-a6e3-e0c794e0e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d67187-54f2-44b0-8c4c-b33cf500ec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:53 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Volume 568de521-7614-44a1-89c8-3355d7e0d4a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568de521-7614-44a1-89c8-3355d7e0d4a2', 'volume_size': 1} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2010207465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568de521-7614-44a1-89c8-3355d7e0d4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:53Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Creating volume 568de521-7614-44a1-89c8-3355d7e0d4a2 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:34:53 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:34:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:53 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2 1073741824 Sep 11 21:34:53 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (d0c35b7f-ec36-4499-89ad-3e3070fa96ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ecb7a2-40ef-4714-9eb7-aafa75ddd4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ecb7a2-40ef-4714-9eb7-aafa75ddd4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1103823885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4532c7-abec-484a-943c-b711c6edb1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:54Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b20a74-e40c-4bb3-b58c-cd9d0bf0763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b20a74-e40c-4bb3-b58c-cd9d0bf0763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2155475-5e6b-4ffb-b42c-288c96301fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2155475-5e6b-4ffb-b42c-288c96301fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad4532c7-abec-484a-943c-b711c6edb1a9', 'volume_name': 'volume-ad4532c7-abec-484a-943c-b711c6edb1a9', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66e52bf-8506-4bf2-a553-dfe702615a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66e52bf-8506-4bf2-a553-dfe702615a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1ef127-d36a-4ce9-913e-bf7228cb069b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:54 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Volume ad4532c7-abec-484a-943c-b711c6edb1a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad4532c7-abec-484a-943c-b711c6edb1a9', 'volume_size': 1} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:54 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2 1073741824" returned: 0 in 1.070s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:54 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2 Sep 11 21:34:54 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:54 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (353414da-ee5c-46a4-ab51-d66f3a6f68cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fbbdfa-8e17-4f40-8868-d88e9ca2f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fbbdfa-8e17-4f40-8868-d88e9ca2f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989302862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9b4b8f-ccac-4e8f-8873-a5594345ac83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:55Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca33e8b7-2343-4cd8-9248-0f81fea21687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca33e8b7-2343-4cd8-9248-0f81fea21687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4261a8d0-0ce7-40ce-8c03-92475c3c997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4261a8d0-0ce7-40ce-8c03-92475c3c997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9b4b8f-ccac-4e8f-8873-a5594345ac83', 'volume_name': 'volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa73116-734f-4a8d-a0fc-660e4faed265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa73116-734f-4a8d-a0fc-660e4faed265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a28909-43a3-4308-859f-15d6ffcf64ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:55 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Volume 6a9b4b8f-ccac-4e8f-8873-a5594345ac83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83', 'volume_size': 1} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:55 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2" returned: 0 in 0.755s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.068s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1103823885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4532c7-abec-484a-943c-b711c6edb1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:54Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Creating volume ad4532c7-abec-484a-943c-b711c6edb1a9 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:34:55 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d67187-54f2-44b0-8c4c-b33cf500ec48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568de521-7614-44a1-89c8-3355d7e0d4a2', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:55 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9 1073741824 Sep 11 21:34:55 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4ec85d-15fd-4c4b-834a-d4da888008d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:55 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Volume volume-568de521-7614-44a1-89c8-3355d7e0d4a2 (568de521-7614-44a1-89c8-3355d7e0d4a2): created successfully Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4ec85d-15fd-4c4b-834a-d4da888008d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (30affdf7-2bb0-4297-8287-8a29a376e019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:55 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3ec8531d-2f25-457e-ac86-e065311ea46d tempest-CreateVolumesFromImageTest-1360577058 None] Created volume successfully. Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (17f1bf28-1219-4c3f-9e22-eb57b4f61db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60085a73-d77a-4de1-8820-c0aae1082d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60085a73-d77a-4de1-8820-c0aae1082d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1610050375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd40f88d-d271-41a3-a9f8-581680fc9254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:56Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adcbe69-3263-4337-9ddb-e3c2d3b86d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adcbe69-3263-4337-9ddb-e3c2d3b86d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9c4403-3011-4af3-ab88-6e22dd8e0518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9c4403-3011-4af3-ab88-6e22dd8e0518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd40f88d-d271-41a3-a9f8-581680fc9254', 'volume_name': 'volume-dd40f88d-d271-41a3-a9f8-581680fc9254', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf174db3-39f6-4870-baaf-ebd086dc34b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf174db3-39f6-4870-baaf-ebd086dc34b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d3a2e8-2c8d-4bb0-9302-c52298fd204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Volume dd40f88d-d271-41a3-a9f8-581680fc9254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd40f88d-d271-41a3-a9f8-581680fc9254', 'volume_size': 1} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (8d3bd698-f2ea-42d6-9551-8dd61b4328bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab18eb3-8d2c-43b8-af7d-a85d65955be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9 1073741824" returned: 0 in 1.158s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab18eb3-8d2c-43b8-af7d-a85d65955be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1286224265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e42dd1d-9e1c-4978-bbd7-91671f6602e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:57Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0117f3-3660-46a8-b7d9-7932f7474acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0117f3-3660-46a8-b7d9-7932f7474acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed767caf-e2f3-4541-a73b-9ab17a9164d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed767caf-e2f3-4541-a73b-9ab17a9164d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e42dd1d-9e1c-4978-bbd7-91671f6602e6', 'volume_name': 'volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d90bc14-915e-41d6-9ad2-b48fc8764934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d90bc14-915e-41d6-9ad2-b48fc8764934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a9be30-7578-40ca-a2a4-fa796fff2fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:56 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Volume 1e42dd1d-9e1c-4978-bbd7-91671f6602e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6', 'volume_size': 1} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:56 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9 Sep 11 21:34:56 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:57 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9" returned: 0 in 0.323s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.033s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989302862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9b4b8f-ccac-4e8f-8873-a5594345ac83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:55Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Creating volume 6a9b4b8f-ccac-4e8f-8873-a5594345ac83 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:34:57 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1ef127-d36a-4ce9-913e-bf7228cb069b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4532c7-abec-484a-943c-b711c6edb1a9', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424d0a8e-909b-45d8-99dd-03bfc96f0e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:57 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 1073741824 Sep 11 21:34:57 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Volume volume-ad4532c7-abec-484a-943c-b711c6edb1a9 (ad4532c7-abec-484a-943c-b711c6edb1a9): created successfully Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424d0a8e-909b-45d8-99dd-03bfc96f0e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (d0c35b7f-ec36-4499-89ad-3e3070fa96ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fa2eca80-0da0-4a79-bc43-0f2056378102 tempest-CreateVolumesFromImageTest-1360577058 None] Created volume successfully. Sep 11 21:34:58 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 1073741824" returned: 0 in 0.757s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:58 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 Sep 11 21:34:58 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:58 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83" returned: 0 in 0.288s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.989s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1610050375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd40f88d-d271-41a3-a9f8-581680fc9254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:56Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Creating volume dd40f88d-d271-41a3-a9f8-581680fc9254 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:34:58 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a28909-43a3-4308-859f-15d6ffcf64ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02313a20-4b65-4926-a11f-ce910032f05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:58 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254 1073741824 Sep 11 21:34:58 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:58 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Volume volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 (6a9b4b8f-ccac-4e8f-8873-a5594345ac83): created successfully Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02313a20-4b65-4926-a11f-ce910032f05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (353414da-ee5c-46a4-ab51-d66f3a6f68cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c3f09960-ab10-4a96-997e-2fbdaaee0270 tempest-CreateVolumesFromImageTest-1360577058 None] Created volume successfully. Sep 11 21:34:59 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254 1073741824" returned: 0 in 0.664s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:59 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254 Sep 11 21:34:59 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:59 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254" returned: 0 in 0.449s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.703s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1286224265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e42dd1d-9e1c-4978-bbd7-91671f6602e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b472846d17468fa62121fda7d7c079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:34:57Z,use_quota=True,user_id='24d939349d214ec8a68f24f5fa5e7630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Creating volume 1e42dd1d-9e1c-4978-bbd7-91671f6602e6 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:34:59 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:34:59 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 1073741824 Sep 11 21:34:59 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d3a2e8-2c8d-4bb0-9302-c52298fd204d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd40f88d-d271-41a3-a9f8-581680fc9254', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7023ef61-06fa-4a8b-a919-972fa52ea6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:34:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Volume volume-dd40f88d-d271-41a3-a9f8-581680fc9254 (dd40f88d-d271-41a3-a9f8-581680fc9254): created successfully Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7023ef61-06fa-4a8b-a919-972fa52ea6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:34:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (17f1bf28-1219-4c3f-9e22-eb57b4f61db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:34:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-56b3dc79-6186-4501-bfc6-fd151027041c tempest-CreateVolumesFromImageTest-1360577058 None] Created volume successfully. Sep 11 21:35:00 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 1073741824" returned: 0 in 0.809s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:00 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 Sep 11 21:35:00 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:00 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6" returned: 0 in 0.456s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:35:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a9be30-7578-40ca-a2a4-fa796fff2fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d790e9de-3a2e-41eb-88d3-4300572cefab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:00 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Volume volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 (1e42dd1d-9e1c-4978-bbd7-91671f6602e6): created successfully Sep 11 21:35:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d790e9de-3a2e-41eb-88d3-4300572cefab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Flow 'volume_create_manager' (8d3bd698-f2ea-42d6-9551-8dd61b4328bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-1e115938-ba0b-44da-bbcf-b4b7c454cdb0 tempest-CreateVolumesFromImageTest-1360577058 None] Created volume successfully. Sep 11 21:35:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-1e42dd1d-9e1c-4978-bbd7-91671f6602e6-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-1e42dd1d-9e1c-4978-bbd7-91671f6602e6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-quobyte-1e42dd1d-9e1c-4978-bbd7-91671f6602e6" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-1e42dd1d-9e1c-4978-bbd7-91671f6602e6" acquired by "delete_volume" :: waited 0.031s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:01 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c09fb8-2796-4d5e-9fd1-c23d84486f38]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:01 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 Sep 11 21:35:01 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:02 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6" returned: 0 in 0.476s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:02 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6 Sep 11 21:35:02 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:02 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1e42dd1d-9e1c-4978-bbd7-91671f6602e6" returned: 0 in 0.334s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-1e42dd1d-9e1c-4978-bbd7-91671f6602e6" released by "delete_volume" :: held 0.896s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Created reservations ['c50b9086-4cec-4b92-8cd6-7573c672974d', '3f47cb04-e6bb-47d1-8c2c-c07d4c35105d', '2c27965b-2996-4f6f-9c7b-3d3d52888979', '76babc1c-0367-4314-ba4e-028b0d0560e1'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:02 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-dd40f88d-d271-41a3-a9f8-581680fc9254-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:02 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-dd40f88d-d271-41a3-a9f8-581680fc9254-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-quobyte-dd40f88d-d271-41a3-a9f8-581680fc9254" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-dd40f88d-d271-41a3-a9f8-581680fc9254" acquired by "delete_volume" :: waited 0.038s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c89c3-6e78-4111-85ec-f1cb193220c4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:03 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.446s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:03 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Deleted volume successfully. Sep 11 21:35:03 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254 Sep 11 21:35:03 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f692f75b-9ce8-4de5-bb4e-98aefbd99ba6 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-1e42dd1d-9e1c-4978-bbd7-91671f6602e6-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:03 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254" returned: 0 in 0.599s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:03 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254 Sep 11 21:35:03 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:04 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-dd40f88d-d271-41a3-a9f8-581680fc9254" returned: 0 in 0.464s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-dd40f88d-d271-41a3-a9f8-581680fc9254" released by "delete_volume" :: held 1.147s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Created reservations ['d9f38f20-679e-467d-95ed-d9560c21c975', '517eb3fc-6c8a-49c0-95dc-0bd77ddde494', 'a8bc461a-1aa3-4a01-ba75-3061f9f1e1e6', '4efe2056-245d-4e93-86a9-878e8545cab1'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:04 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:04 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:04 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.347s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Deleted volume successfully. Sep 11 21:35:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6ac5298f-6c10-4516-b6d0-36761d3fd28d tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-dd40f88d-d271-41a3-a9f8-581680fc9254-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-6a9b4b8f-ccac-4e8f-8873-a5594345ac83-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-6a9b4b8f-ccac-4e8f-8873-a5594345ac83-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-quobyte-6a9b4b8f-ccac-4e8f-8873-a5594345ac83" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-6a9b4b8f-ccac-4e8f-8873-a5594345ac83" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:05 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d467cd-4506-44a0-b939-e50eca9f0972]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:05 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 Sep 11 21:35:05 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:05 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83" returned: 0 in 0.553s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:05 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83 Sep 11 21:35:05 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:06 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a9b4b8f-ccac-4e8f-8873-a5594345ac83" returned: 0 in 0.436s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-6a9b4b8f-ccac-4e8f-8873-a5594345ac83" released by "delete_volume" :: held 1.058s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Created reservations ['d676f5da-ba49-4d03-a26c-687380885c24', '518ac972-74df-426c-85d4-9b3fc7f4f7c9', 'bbef390b-2a53-4c81-9c91-0a9d8dfffa51', '25667cbf-1d08-4c44-9490-d73f8db12bd3'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:06 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:06 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:06 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.285s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Deleted volume successfully. Sep 11 21:35:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d69953-3ddf-48c1-a221-7abe1ec6800e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-6a9b4b8f-ccac-4e8f-8873-a5594345ac83-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-ad4532c7-abec-484a-943c-b711c6edb1a9-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-ad4532c7-abec-484a-943c-b711c6edb1a9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-quobyte-ad4532c7-abec-484a-943c-b711c6edb1a9" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-ad4532c7-abec-484a-943c-b711c6edb1a9" acquired by "delete_volume" :: waited 0.031s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffe37df-222a-40b7-a3c5-e6e6aba88f96]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:07 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9 Sep 11 21:35:07 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:08 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9" returned: 0 in 0.422s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:08 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9 Sep 11 21:35:08 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:08 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ad4532c7-abec-484a-943c-b711c6edb1a9" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-ad4532c7-abec-484a-943c-b711c6edb1a9" released by "delete_volume" :: held 0.768s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Created reservations ['f8cb80c9-b153-4727-bafc-4f5caf3a0a8e', '4dadd462-a646-4804-847d-e6ca1277c844', 'ba61c912-d150-4710-bd4a-1627cb60a56f', '08f4fa8c-6ca2-45cf-bb43-b4326558414b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:08 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:08 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-568de521-7614-44a1-89c8-3355d7e0d4a2-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-568de521-7614-44a1-89c8-3355d7e0d4a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "cinder-quobyte-568de521-7614-44a1-89c8-3355d7e0d4a2" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-568de521-7614-44a1-89c8-3355d7e0d4a2" acquired by "delete_volume" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff19f0f5-5a93-48b3-95f8-495ce1e01108]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:09 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.452s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Deleted volume successfully. Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6583c2a0-d22b-4a95-8734-08a3ecac514e tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-ad4532c7-abec-484a-943c-b711c6edb1a9-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:09 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2 Sep 11 21:35:09 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:09 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2" returned: 0 in 0.459s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:09 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2 Sep 11 21:35:09 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:09 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-568de521-7614-44a1-89c8-3355d7e0d4a2" returned: 0 in 0.357s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-quobyte-568de521-7614-44a1-89c8-3355d7e0d4a2" released by "delete_volume" :: held 0.910s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:09 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Created reservations ['c00f6c2d-847e-4fb6-8698-e1f99abf63b9', '9004095f-6d56-4e9f-a8e1-2c4a9424941b', 'cc6d948f-93a8-498e-a9d3-daff0cc1e236', '25c92c69-e22e-4e02-82ce-b62e3b00c24d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:10 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:10 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:10 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.317s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:10 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Deleted volume successfully. Sep 11 21:35:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-eb552b4a-c446-47fb-b681-8c7ca3fc8bd4 tempest-CreateVolumesFromImageTest-1360577058 None] Lock "cinder-568de521-7614-44a1-89c8-3355d7e0d4a2-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:35:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:15 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:15 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:16 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.269s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Flow 'volume_create_manager' (5b3689c2-2b7f-40dd-bbc9-4241cc322d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97156139-1457-4f44-817c-5b824c93d976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97156139-1457-4f44-817c-5b824c93d976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1145662333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b6a463-6f84-407c-9a26-1f6ab33bdfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d428e50a1b34489da7909e204ed53b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:17Z,use_quota=True,user_id='ab536439d3c6464abc0f3ae5876c3bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af79029-7b6d-4932-a907-721d6eafdce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af79029-7b6d-4932-a907-721d6eafdce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85e52b9-3abf-4ed4-9937-883d44a94207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85e52b9-3abf-4ed4-9937-883d44a94207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b6a463-6f84-407c-9a26-1f6ab33bdfaf', 'volume_name': 'volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f42f61-c758-4445-9354-abe4848edb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f42f61-c758-4445-9354-abe4848edb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826a1aeb-b0a7-4413-8fa5-89099018ce0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:16 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Volume c1b6a463-6f84-407c-9a26-1f6ab33bdfaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf', 'volume_size': 1} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1145662333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b6a463-6f84-407c-9a26-1f6ab33bdfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d428e50a1b34489da7909e204ed53b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:17Z,use_quota=True,user_id='ab536439d3c6464abc0f3ae5876c3bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Creating volume c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:35:16 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:35:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:16 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf 1073741824 Sep 11 21:35:16 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:17 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf 1073741824" returned: 0 in 0.542s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:17 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf Sep 11 21:35:17 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:17 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" returned: 0 in 0.306s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:35:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826a1aeb-b0a7-4413-8fa5-89099018ce0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b326167-ca6b-4a95-98a5-ad7beb097b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:17 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Volume volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf (c1b6a463-6f84-407c-9a26-1f6ab33bdfaf): created successfully Sep 11 21:35:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b326167-ca6b-4a95-98a5-ad7beb097b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Flow 'volume_create_manager' (5b3689c2-2b7f-40dd-bbc9-4241cc322d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3daa541e-1123-4bf7-89df-0f55e4388e39 tempest-VolumeDependencyTests-633595265 None] Created volume successfully. Sep 11 21:35:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Creating offline snapshot ebbefbb8-6c11-4e63-bc4d-4433ece3c667 of volume c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:35:19 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa5ab6d-89d8-4f8c-9ae8-ace7be0c0976]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:19 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-db7032d8-5854-4add-95c8-3bb24ff8adf4 req-1a08a9f8-0065-4dc8-9058-2b28a7923c14 tempest-TestShelveInstance-1274408701 None] Terminate volume connection completed successfully. Sep 11 21:35:19 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-db7032d8-5854-4add-95c8-3bb24ff8adf4 req-1a08a9f8-0065-4dc8-9058-2b28a7923c14 tempest-TestShelveInstance-1274408701 None] Deleting attachment 6e2e8436-44e8-421f-b740-cf7ba4d4fcc4. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:35:19 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf Sep 11 21:35:19 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:19 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" returned: 0 in 0.484s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:19 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 1G Sep 11 21:35:19 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:20 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 1G" returned: 0 in 0.701s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:20 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 Sep 11 21:35:20 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:20 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667" returned: 0 in 0.393s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:20 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 is being set with open permissions: ugo+rw Sep 11 21:35:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:20 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 Sep 11 21:35:20 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:21 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667" returned: 0 in 0.357s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:21 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=100,cinder:UPDATE=119,cinder:DELETE=7,cinder:INSERT=29 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:35:21 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=91,cinder:UPDATE=116,cinder:INSERT=36,cinder:DELETE=12 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:35:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:21 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.info Sep 11 21:35:21 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:21 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.info" returned: 0 in 0.344s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:21 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.info is being set with open permissions: ugo+rw Sep 11 21:35:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:21 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.info Sep 11 21:35:21 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:21 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.info" returned: 0 in 0.298s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.742s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f4fe5c44-39d6-4934-ae31-2286f2168787 tempest-VolumeDependencyTests-633595265 None] Create snapshot completed successfully Sep 11 21:35:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-03acb362-3681-487d-859e-bdbfbdd72388 req-257d00a3-10cc-4dae-899a-4a1d0672e185 tempest-TestShelveInstance-1274408701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-03acb362-3681-487d-859e-bdbfbdd72388 req-257d00a3-10cc-4dae-899a-4a1d0672e185 tempest-TestShelveInstance-1274408701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-03acb362-3681-487d-859e-bdbfbdd72388 req-257d00a3-10cc-4dae-899a-4a1d0672e185 tempest-TestShelveInstance-1274408701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-03acb362-3681-487d-859e-bdbfbdd72388 req-257d00a3-10cc-4dae-899a-4a1d0672e185 tempest-TestShelveInstance-1274408701 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c00d9f3b-c28a-441f-bba2-6623c885e799', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:35:23 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-03acb362-3681-487d-859e-bdbfbdd72388 req-257d00a3-10cc-4dae-899a-4a1d0672e185 tempest-TestShelveInstance-1274408701 None] attachment_update completed successfully. Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Flow 'volume_create_manager' (c9897e1e-7ebc-4769-9e01-d788a1275f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4376682-1057-47be-9fe2-29dff15733b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4376682-1057-47be-9fe2-29dff15733b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-502300914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e13886-0621-4c35-b03a-8f3a33a71fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d428e50a1b34489da7909e204ed53b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebbefbb8-6c11-4e63-bc4d-4433ece3c667,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:23Z,use_quota=True,user_id='ab536439d3c6464abc0f3ae5876c3bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2a10ce-c3ce-42a5-b9e1-c0526e871906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2a10ce-c3ce-42a5-b9e1-c0526e871906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34abfa82-4c93-4602-a965-69853ad11523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34abfa82-4c93-4602-a965-69853ad11523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88e13886-0621-4c35-b03a-8f3a33a71fe0', 'volume_name': 'volume-88e13886-0621-4c35-b03a-8f3a33a71fe0', 'volume_size': 1, 'snapshot_id': 'ebbefbb8-6c11-4e63-bc4d-4433ece3c667'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5539325f-13ff-48a0-8204-50dd566eec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5539325f-13ff-48a0-8204-50dd566eec26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7814d4-0542-40de-8667-5e1717e25dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:23 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Volume 88e13886-0621-4c35-b03a-8f3a33a71fe0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88e13886-0621-4c35-b03a-8f3a33a71fe0', 'volume_size': 1, 'snapshot_id': 'ebbefbb8-6c11-4e63-bc4d-4433ece3c667'} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Acquiring lock "cinder-quobyte-ebbefbb8-6c11-4e63-bc4d-4433ece3c667-88e13886-0621-4c35-b03a-8f3a33a71fe0" by "_create_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-ebbefbb8-6c11-4e63-bc4d-4433ece3c667-88e13886-0621-4c35-b03a-8f3a33a71fe0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Creating volume 88e13886-0621-4c35-b03a-8f3a33a71fe0 from snapshot ebbefbb8-6c11-4e63-bc4d-4433ece3c667 {{(pid=87423) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Acquiring lock "cinder-quobyte-88e13886-0621-4c35-b03a-8f3a33a71fe0" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-88e13886-0621-4c35-b03a-8f3a33a71fe0" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] snapshot: ebbefbb8-6c11-4e63-bc4d-4433ece3c667, volume: 88e13886-0621-4c35-b03a-8f3a33a71fe0, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b76cd7-10a1-4746-be21-b9d62102af1f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:23 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 Sep 11 21:35:23 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:24 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667" returned: 0 in 0.820s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:35:24 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[56636ed7-e741-4d7f-aafe-95ca403b9df7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:24 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf Sep 11 21:35:24 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:25 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" returned: 0 in 0.654s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:35:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:35:25 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:35:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:25 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 Sep 11 21:35:25 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:32 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0" returned: 0 in 7.127s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf, size 1024.00 MB, duration 7.13 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:35:32 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Converted 1024.00 MB image at 143.64 MB/s Sep 11 21:35:32 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 is being set with open permissions: ugo+rw Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:32 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 Sep 11 21:35:32 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:32 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0" returned: 0 in 0.397s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-88e13886-0621-4c35-b03a-8f3a33a71fe0" released by "_copy_volume_from_snapshot" :: held 9.183s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-ebbefbb8-6c11-4e63-bc4d-4433ece3c667-88e13886-0621-4c35-b03a-8f3a33a71fe0" released by "_create_volume_from_snapshot" :: held 9.274s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.296s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7814d4-0542-40de-8667-5e1717e25dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e13886-0621-4c35-b03a-8f3a33a71fe0', 'volume_size': 1, 'snapshot_id': 'ebbefbb8-6c11-4e63-bc4d-4433ece3c667'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b813817a-1503-4095-8122-f1651d7c114a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:32 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Volume volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 (88e13886-0621-4c35-b03a-8f3a33a71fe0): created successfully Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b813817a-1503-4095-8122-f1651d7c114a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Flow 'volume_create_manager' (c9897e1e-7ebc-4769-9e01-d788a1275f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:32 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-05fc7962-0795-41bc-a2da-36e21dab73aa tempest-VolumeDependencyTests-633595265 None] Created volume successfully. Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Acquiring lock "cinder-ebbefbb8-6c11-4e63-bc4d-4433ece3c667-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Lock "cinder-ebbefbb8-6c11-4e63-bc4d-4433ece3c667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Acquiring lock "cinder-quobyte-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Acquiring lock "cinder-quobyte-ebbefbb8-6c11-4e63-bc4d-4433ece3c667" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-ebbefbb8-6c11-4e63-bc4d-4433ece3c667" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Deleting offline snapshot ebbefbb8-6c11-4e63-bc4d-4433ece3c667 of volume c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] snapshot_file for this snap is: volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7166f40-012c-4251-9023-bff21aad590b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:34 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 Sep 11 21:35:34 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:34 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667" returned: 0 in 0.432s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:35:34 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[448acc87-7a53-4163-99e0-953a44560fc9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:34 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf Sep 11 21:35:34 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:35 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" returned: 0 in 0.824s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:35 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 Sep 11 21:35:35 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:35 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667" returned: 0 in 0.633s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:35 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667 Sep 11 21:35:35 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:36 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf.ebbefbb8-6c11-4e63-bc4d-4433ece3c667" returned: 0 in 0.657s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-ebbefbb8-6c11-4e63-bc4d-4433ece3c667" released by "_delete_snapshot" :: held 2.738s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" released by "delete_snapshot" :: held 2.784s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:36 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Created reservations ['9c23c4e1-9f1d-4d2a-8ff0-a535accb5a8f', 'd3598129-aba3-49e1-9f96-951ede609b87', '937c4e8f-6712-4b88-a392-f95c1065f9ed', '1da7bf3f-0ded-4d98-8a21-a90ec291e034'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:36 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Delete snapshot completed successfully. Sep 11 21:35:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a733ef42-2856-473f-a3f2-4bda2e2c64fd tempest-VolumeDependencyTests-633595265 None] Lock "cinder-ebbefbb8-6c11-4e63-bc4d-4433ece3c667-delete_snapshot" released by "delete_snapshot" :: held 3.166s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Acquiring lock "cinder-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Lock "cinder-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Acquiring lock "cinder-quobyte-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:37 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[344abb1a-2a39-4797-9686-4809efd1dca7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:37 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf Sep 11 21:35:37 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:38 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" returned: 0 in 0.637s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:38 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf Sep 11 21:35:38 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:38 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" returned: 0 in 0.327s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf" released by "delete_volume" :: held 1.054s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Created reservations ['2df0235f-82df-4050-b126-af48bd735b96', '5df8cd26-8de1-49ac-8018-b7b0a1e6da3c', '4d668511-a410-4256-8cb4-a870ce309515', 'd537f6bc-f86d-486d-8110-a96505d2116a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:38 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:38 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:38 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.266s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Deleted volume successfully. Sep 11 21:35:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f9cd3544-3c20-4456-8c39-7b26d83de019 tempest-VolumeDependencyTests-633595265 None] Lock "cinder-c1b6a463-6f84-407c-9a26-1f6ab33bdfaf-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Acquiring lock "cinder-88e13886-0621-4c35-b03a-8f3a33a71fe0-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Lock "cinder-88e13886-0621-4c35-b03a-8f3a33a71fe0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Acquiring lock "cinder-quobyte-88e13886-0621-4c35-b03a-8f3a33a71fe0" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-88e13886-0621-4c35-b03a-8f3a33a71fe0" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:39 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[983c2f45-989f-4381-a81c-1ddca69593ea]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:40 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 Sep 11 21:35:40 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:40 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0" returned: 0 in 0.673s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:40 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0 Sep 11 21:35:40 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (39fab8e0-f5e1-44e0-9da6-4761bf63d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2738f9f-4f3b-43d3-a243-317510fd12a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2738f9f-4f3b-43d3-a243-317510fd12a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-928968605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020e7340-154e-4d30-afb5-7405940264cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:41Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0a9805-2635-47d7-8749-f09bf0074626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0a9805-2635-47d7-8749-f09bf0074626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f04a82-0294-4f4a-aeaa-3ac197dea7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f04a82-0294-4f4a-aeaa-3ac197dea7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020e7340-154e-4d30-afb5-7405940264cc', 'volume_name': 'volume-020e7340-154e-4d30-afb5-7405940264cc', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd5d3b7-8018-4eec-91d6-ed321a642e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd5d3b7-8018-4eec-91d6-ed321a642e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88613667-6c60-4474-98e5-f4ef88aa2ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:40 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Volume 020e7340-154e-4d30-afb5-7405940264cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020e7340-154e-4d30-afb5-7405940264cc', 'volume_size': 1} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-928968605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020e7340-154e-4d30-afb5-7405940264cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:41Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Creating volume 020e7340-154e-4d30-afb5-7405940264cc {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:35:40 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:40 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc 1073741824 Sep 11 21:35:40 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:40 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-88e13886-0621-4c35-b03a-8f3a33a71fe0" returned: 0 in 0.390s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Lock "cinder-quobyte-88e13886-0621-4c35-b03a-8f3a33a71fe0" released by "delete_volume" :: held 1.118s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:40 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Created reservations ['ce53639f-5658-4557-a272-d85c1ab9aab2', 'c564c09c-a644-48c9-b5d6-be09f6e50fc0', 'd479cacc-f468-44d4-9f37-dc42577ac6a3', '3015d617-9eae-4d6c-9dcb-06f2fdca0c5b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:41 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:41 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:41 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc 1073741824" returned: 0 in 0.533s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:41 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.304s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:41 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc Sep 11 21:35:41 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Deleted volume successfully. Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b223fd52-6f5b-41f1-9c2c-4cb61ca80c32 tempest-VolumeDependencyTests-633595265 None] Lock "cinder-88e13886-0621-4c35-b03a-8f3a33a71fe0-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:41 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc" returned: 0 in 0.296s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88613667-6c60-4474-98e5-f4ef88aa2ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020e7340-154e-4d30-afb5-7405940264cc', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab54001-7926-41ae-8360-32e4e92eda0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:41 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Volume volume-020e7340-154e-4d30-afb5-7405940264cc (020e7340-154e-4d30-afb5-7405940264cc): created successfully Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab54001-7926-41ae-8360-32e4e92eda0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (39fab8e0-f5e1-44e0-9da6-4761bf63d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5d9db3c6-76c3-4060-ad6b-30db5ddae141 tempest-VolumesActionsTest-1394967502 None] Created volume successfully. Sep 11 21:35:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7b2f83bd-23cd-4c19-9e99-901788528a5e tempest-VolumesActionsTest-1394967502 None] Acquiring lock "cinder-020e7340-154e-4d30-afb5-7405940264cc" by "attach_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7b2f83bd-23cd-4c19-9e99-901788528a5e tempest-VolumesActionsTest-1394967502 None] Lock "cinder-020e7340-154e-4d30-afb5-7405940264cc" acquired by "attach_volume" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:42 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-7b2f83bd-23cd-4c19-9e99-901788528a5e tempest-VolumesActionsTest-1394967502 None] Attaching volume 020e7340-154e-4d30-afb5-7405940264cc to instance 90fe478d-a267-4aad-ad3b-52f86f407f60 at mountpoint /dev/vdb on host None. Sep 11 21:35:42 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-7b2f83bd-23cd-4c19-9e99-901788528a5e tempest-VolumesActionsTest-1394967502 None] Attach volume completed successfully. Sep 11 21:35:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7b2f83bd-23cd-4c19-9e99-901788528a5e tempest-VolumesActionsTest-1394967502 None] Lock "cinder-020e7340-154e-4d30-afb5-7405940264cc" released by "attach_volume" :: held 0.175s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:43 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-665dae10-4f0a-465e-b40e-6c7f9a07369c tempest-VolumesActionsTest-1850223508 None] Terminate volume connection completed successfully. Sep 11 21:35:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-665dae10-4f0a-465e-b40e-6c7f9a07369c tempest-VolumesActionsTest-1850223508 None] Acquiring lock "cinder-020e7340-154e-4d30-afb5-7405940264cc-detach_volume" by "detach_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-665dae10-4f0a-465e-b40e-6c7f9a07369c tempest-VolumesActionsTest-1850223508 None] Lock "cinder-020e7340-154e-4d30-afb5-7405940264cc-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-665dae10-4f0a-465e-b40e-6c7f9a07369c tempest-VolumesActionsTest-1850223508 None] Detaching volume 020e7340-154e-4d30-afb5-7405940264cc from instance 90fe478d-a267-4aad-ad3b-52f86f407f60. Sep 11 21:35:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-665dae10-4f0a-465e-b40e-6c7f9a07369c tempest-VolumesActionsTest-1850223508 None] Detach volume completed successfully. Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-665dae10-4f0a-465e-b40e-6c7f9a07369c tempest-VolumesActionsTest-1850223508 None] Lock "cinder-020e7340-154e-4d30-afb5-7405940264cc-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-54aec5ed-9631-4ba6-b01d-4c1fee12e179 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "cinder-020e7340-154e-4d30-afb5-7405940264cc-detach_volume" by "detach_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-54aec5ed-9631-4ba6-b01d-4c1fee12e179 tempest-VolumesActionsTest-1394967502 None] Lock "cinder-020e7340-154e-4d30-afb5-7405940264cc-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-54aec5ed-9631-4ba6-b01d-4c1fee12e179 tempest-VolumesActionsTest-1394967502 None] Volume detach called, but volume not attached. Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-54aec5ed-9631-4ba6-b01d-4c1fee12e179 tempest-VolumesActionsTest-1394967502 None] Lock "cinder-020e7340-154e-4d30-afb5-7405940264cc-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Acquiring lock "cinder-020e7340-154e-4d30-afb5-7405940264cc-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Lock "cinder-020e7340-154e-4d30-afb5-7405940264cc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Acquiring lock "cinder-quobyte-020e7340-154e-4d30-afb5-7405940264cc" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Lock "cinder-quobyte-020e7340-154e-4d30-afb5-7405940264cc" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f52c83-46a7-4254-a6ff-3ce12f428e99]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:44 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc Sep 11 21:35:44 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:45 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc" returned: 0 in 0.423s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:45 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc Sep 11 21:35:45 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:45 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-020e7340-154e-4d30-afb5-7405940264cc" returned: 0 in 0.367s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Lock "cinder-quobyte-020e7340-154e-4d30-afb5-7405940264cc" released by "delete_volume" :: held 0.893s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Created reservations ['7e79076c-e7b1-4628-a439-d986319a7ec2', '5da4eb90-a567-4b29-8b26-84e1d2fdb74f', 'e6616bf2-cff0-478c-ade8-9c101fb50744', 'f276fc93-0c7d-4b65-abe0-99b75e675e12'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:45 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:45 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Flow 'volume_create_manager' (cca28e23-924a-47c3-9e15-d5f37a5a0aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a7c5f0-9114-410e-aa39-26e91bfc9f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a7c5f0-9114-410e-aa39-26e91bfc9f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f2dbba-6f25-47cc-9580-6dfcefaa415f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14064bedb5544f2add5c9add548a1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:46Z,use_quota=True,user_id='c53e112774ca45b5ba62ab474a4fadac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fae4c3-ef9f-4c3e-bd3c-c31b0af3c371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fae4c3-ef9f-4c3e-bd3c-c31b0af3c371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea964473-0a2e-45fc-85a9-dd4946c87030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea964473-0a2e-45fc-85a9-dd4946c87030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f2dbba-6f25-47cc-9580-6dfcefaa415f', 'volume_name': 'volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98e15c9-5965-498f-ab21-b88d476de348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98e15c9-5965-498f-ab21-b88d476de348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d47316d-247a-4409-99a6-c3292023da6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:46 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Volume 52f2dbba-6f25-47cc-9580-6dfcefaa415f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f', 'volume_size': 1} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f2dbba-6f25-47cc-9580-6dfcefaa415f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14064bedb5544f2add5c9add548a1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:46Z,use_quota=True,user_id='c53e112774ca45b5ba62ab474a4fadac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Creating volume 52f2dbba-6f25-47cc-9580-6dfcefaa415f {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:35:46 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:46 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f 1073741824 Sep 11 21:35:46 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:46 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.483s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Deleted volume successfully. Sep 11 21:35:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df929d8e-47c0-4fe5-a771-1168907dae2f tempest-VolumesActionsTest-1394967502 None] Lock "cinder-020e7340-154e-4d30-afb5-7405940264cc-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:47 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f 1073741824" returned: 0 in 0.854s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:47 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f Sep 11 21:35:47 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:47 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f" returned: 0 in 0.308s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:35:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d47316d-247a-4409-99a6-c3292023da6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e98f31b-057f-41d4-9488-6c4b333d9ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:47 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Volume volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f (52f2dbba-6f25-47cc-9580-6dfcefaa415f): created successfully Sep 11 21:35:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e98f31b-057f-41d4-9488-6c4b333d9ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Flow 'volume_create_manager' (cca28e23-924a-47c3-9e15-d5f37a5a0aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:47 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-435b670b-af99-47b9-87bc-c22a05f6453c tempest-CinderUnicodeTest-316806202 None] Created volume successfully. Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Flow 'volume_create_manager' (33b8c4fa-1267-42d5-bc5d-e7d2e64fbac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453e180a-2b6b-4eda-aeae-d483012c89db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453e180a-2b6b-4eda-aeae-d483012c89db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2070121666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40dd3929-0594-494d-9f1c-a95607a7b432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14064bedb5544f2add5c9add548a1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:49Z,use_quota=True,user_id='c53e112774ca45b5ba62ab474a4fadac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2e1a66-491f-4bcd-8dd6-f9eb90f7ccae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2e1a66-491f-4bcd-8dd6-f9eb90f7ccae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6759f1f-58ab-4749-8206-56b7eee1e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6759f1f-58ab-4749-8206-56b7eee1e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40dd3929-0594-494d-9f1c-a95607a7b432', 'volume_name': 'volume-40dd3929-0594-494d-9f1c-a95607a7b432', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9382de-8703-4e4b-a435-8f5adaab645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9382de-8703-4e4b-a435-8f5adaab645b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16c49f0-1df7-4654-b00a-95aeb5350dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:48 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Volume 40dd3929-0594-494d-9f1c-a95607a7b432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40dd3929-0594-494d-9f1c-a95607a7b432', 'volume_size': 1} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2070121666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40dd3929-0594-494d-9f1c-a95607a7b432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14064bedb5544f2add5c9add548a1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:49Z,use_quota=True,user_id='c53e112774ca45b5ba62ab474a4fadac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Creating volume 40dd3929-0594-494d-9f1c-a95607a7b432 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:35:48 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:35:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:48 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 1073741824 Sep 11 21:35:48 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:49 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 1073741824" returned: 0 in 0.464s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:49 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 Sep 11 21:35:49 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (218fe695-1fe3-4325-b932-3b009cd90bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a72772-ecca-479d-9f02-c516040dd5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a72772-ecca-479d-9f02-c516040dd5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1979729624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d1e7c5-108f-425a-a7cf-74dac714d61c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:50Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:49 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e26073-c118-4ef6-a5ab-6899d199a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e26073-c118-4ef6-a5ab-6899d199a890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a580a8-7f6f-4267-98a9-94d2bf34133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a580a8-7f6f-4267-98a9-94d2bf34133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d1e7c5-108f-425a-a7cf-74dac714d61c', 'volume_name': 'volume-57d1e7c5-108f-425a-a7cf-74dac714d61c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886f7867-ba7e-4df6-a476-3c68418ac9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886f7867-ba7e-4df6-a476-3c68418ac9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168e37b0-ca7f-4904-b105-6c22ee6005eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:49 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Volume 57d1e7c5-108f-425a-a7cf-74dac714d61c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d1e7c5-108f-425a-a7cf-74dac714d61c', 'volume_size': 1} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432" returned: 0 in 0.322s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1979729624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d1e7c5-108f-425a-a7cf-74dac714d61c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:50Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Creating volume 57d1e7c5-108f-425a-a7cf-74dac714d61c {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:35:49 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16c49f0-1df7-4654-b00a-95aeb5350dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40dd3929-0594-494d-9f1c-a95607a7b432', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:49 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c 1073741824 Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e320252-6086-41fd-bc9a-36645851f797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:49 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:49 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Volume volume-40dd3929-0594-494d-9f1c-a95607a7b432 (40dd3929-0594-494d-9f1c-a95607a7b432): created successfully Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e320252-6086-41fd-bc9a-36645851f797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Flow 'volume_create_manager' (33b8c4fa-1267-42d5-bc5d-e7d2e64fbac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fc805654-2305-4c67-8cfd-5e91002abad6 tempest-CinderUnicodeTest-316806202 None] Created volume successfully. Sep 11 21:35:50 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c 1073741824" returned: 0 in 0.423s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:50 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c Sep 11 21:35:50 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:50 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c" returned: 0 in 0.259s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168e37b0-ca7f-4904-b105-6c22ee6005eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d1e7c5-108f-425a-a7cf-74dac714d61c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e243f8f2-a1c7-4427-bb4d-32b977695162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Volume volume-57d1e7c5-108f-425a-a7cf-74dac714d61c (57d1e7c5-108f-425a-a7cf-74dac714d61c): created successfully Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e243f8f2-a1c7-4427-bb4d-32b977695162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (218fe695-1fe3-4325-b932-3b009cd90bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-900741f5-4486-4ace-837d-c3c237eabac7 tempest-VolumesActionsTest-1394967502 None] Created volume successfully. Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "cinder-57d1e7c5-108f-425a-a7cf-74dac714d61c-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-57d1e7c5-108f-425a-a7cf-74dac714d61c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "cinder-quobyte-57d1e7c5-108f-425a-a7cf-74dac714d61c" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-quobyte-57d1e7c5-108f-425a-a7cf-74dac714d61c" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d722bf6c-e198-4b88-b9df-6400a8f554ac]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:50 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c Sep 11 21:35:50 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Creating offline snapshot c843d398-9dd8-4aab-9495-5d28ae60a4f4 of volume 40dd3929-0594-494d-9f1c-a95607a7b432 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41913b0-a6e6-41d2-952f-ed77aab6dd6c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:51 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c" returned: 0 in 0.382s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:51 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c Sep 11 21:35:51 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:51 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 Sep 11 21:35:51 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:51 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-57d1e7c5-108f-425a-a7cf-74dac714d61c" returned: 0 in 0.261s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-quobyte-57d1e7c5-108f-425a-a7cf-74dac714d61c" released by "delete_volume" :: held 0.694s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:51 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432" returned: 0 in 0.391s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Created reservations ['76f7852d-d407-4a61-981b-bb39f53748e7', 'd966787d-46fb-4f90-9f99-01051a92fcb9', '9b410844-ce2e-4163-b562-9e1fee4006e3', '91be5cd9-7b1e-447f-b6d8-947a1108405d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:51 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 1G Sep 11 21:35:51 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:51 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:51 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:51 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.257s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:51 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Deleted volume successfully. Sep 11 21:35:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-83b5aeda-ea05-4481-b5a6-734fdff509b8 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-57d1e7c5-108f-425a-a7cf-74dac714d61c-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:52 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 1G" returned: 0 in 0.486s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40dd3929-0594-494d-9f1c-a95607a7b432 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:52 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40dd3929-0594-494d-9f1c-a95607a7b432 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 Sep 11 21:35:52 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:52 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40dd3929-0594-494d-9f1c-a95607a7b432 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4" returned: 0 in 0.323s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:52 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 is being set with open permissions: ugo+rw Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:52 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 Sep 11 21:35:52 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (62fd45df-ec1d-4574-bd28-92123359ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69e8a82-de35-48c1-9f4e-af579e0b55c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69e8a82-de35-48c1-9f4e-af579e0b55c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972414685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2703cf99-2b56-4d36-884a-b2ae4e79e497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:52Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6fb068-1b55-44ae-b741-4d9beda95da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6fb068-1b55-44ae-b741-4d9beda95da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c13c109-77f7-4267-8df6-174d26df59b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c13c109-77f7-4267-8df6-174d26df59b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2703cf99-2b56-4d36-884a-b2ae4e79e497', 'volume_name': 'volume-2703cf99-2b56-4d36-884a-b2ae4e79e497', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f048294-b595-4f8a-96dc-fc908f8e9ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f048294-b595-4f8a-96dc-fc908f8e9ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d961f762-7fb1-46c1-8afb-f15cc6eca947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:52 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Volume 2703cf99-2b56-4d36-884a-b2ae4e79e497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2703cf99-2b56-4d36-884a-b2ae4e79e497', 'volume_size': 1} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:52 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4" returned: 0 in 0.238s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:52 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.info Sep 11 21:35:52 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:52 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.info" returned: 0 in 0.248s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:52 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.info is being set with open permissions: ugo+rw Sep 11 21:35:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:52 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.info Sep 11 21:35:52 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:53 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.info" returned: 0 in 0.245s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972414685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2703cf99-2b56-4d36-884a-b2ae4e79e497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:52Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Creating volume 2703cf99-2b56-4d36-884a-b2ae4e79e497 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:35:53 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:53 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 1073741824 Sep 11 21:35:53 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:53 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0985a74d-51b2-49ca-b5a3-a215f6411714 tempest-CinderUnicodeTest-316806202 None] Create snapshot completed successfully Sep 11 21:35:53 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 1073741824" returned: 0 in 0.437s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:53 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 Sep 11 21:35:53 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:53 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497" returned: 0 in 0.242s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d961f762-7fb1-46c1-8afb-f15cc6eca947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2703cf99-2b56-4d36-884a-b2ae4e79e497', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb95f3a0-224e-41d2-a43c-40b26793eaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:53 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Volume volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 (2703cf99-2b56-4d36-884a-b2ae4e79e497): created successfully Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb95f3a0-224e-41d2-a43c-40b26793eaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:53 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (62fd45df-ec1d-4574-bd28-92123359ea73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:53 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cc26c99d-4828-4473-a4a9-07c8524bde33 tempest-VolumesActionsTest-1394967502 None] Created volume successfully. Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "cinder-c843d398-9dd8-4aab-9495-5d28ae60a4f4-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-c843d398-9dd8-4aab-9495-5d28ae60a4f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "cinder-quobyte-40dd3929-0594-494d-9f1c-a95607a7b432" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-quobyte-40dd3929-0594-494d-9f1c-a95607a7b432" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "cinder-quobyte-c843d398-9dd8-4aab-9495-5d28ae60a4f4" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-quobyte-c843d398-9dd8-4aab-9495-5d28ae60a4f4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Deleting offline snapshot c843d398-9dd8-4aab-9495-5d28ae60a4f4 of volume 40dd3929-0594-494d-9f1c-a95607a7b432 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] snapshot_file for this snap is: volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52d6a4d-07df-40b6-8f97-d55acc20cb57]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:54 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 Sep 11 21:35:54 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "cinder-2703cf99-2b56-4d36-884a-b2ae4e79e497-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-2703cf99-2b56-4d36-884a-b2ae4e79e497-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:54 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4" returned: 0 in 0.430s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40dd3929-0594-494d-9f1c-a95607a7b432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "cinder-quobyte-2703cf99-2b56-4d36-884a-b2ae4e79e497" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadf7dfb-cf80-4f6d-b8c5-7fc3b01227f4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-quobyte-2703cf99-2b56-4d36-884a-b2ae4e79e497" acquired by "delete_volume" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5980b87-9bf2-4d0d-82c2-8e41b7005513]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:54 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 Sep 11 21:35:54 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:54 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 Sep 11 21:35:54 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:55 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432" returned: 0 in 0.412s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:55 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 Sep 11 21:35:55 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:55 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497" returned: 0 in 0.392s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:55 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497 Sep 11 21:35:55 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:55 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-2703cf99-2b56-4d36-884a-b2ae4e79e497" returned: 0 in 0.275s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-quobyte-2703cf99-2b56-4d36-884a-b2ae4e79e497" released by "delete_volume" :: held 0.724s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Created reservations ['4f742b02-871b-434a-bedc-84fe7456d2c9', '9a26c866-c76d-4608-b635-fa2fd0eff565', '69634f61-77e6-4aef-b689-ee7ddd89e710', '1b04f021-c34f-427f-9cd2-3eccfe10147b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:55 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4" returned: 0 in 0.455s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:55 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4 Sep 11 21:35:55 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:55 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:55 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:55 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432.c843d398-9dd8-4aab-9495-5d28ae60a4f4" returned: 0 in 0.307s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:56 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-quobyte-c843d398-9dd8-4aab-9495-5d28ae60a4f4" released by "_delete_snapshot" :: held 1.731s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.301s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-quobyte-40dd3929-0594-494d-9f1c-a95607a7b432" released by "delete_snapshot" :: held 1.760s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Deleted volume successfully. Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c36e92c-5320-4e6d-80b0-f58b8295a127 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-2703cf99-2b56-4d36-884a-b2ae4e79e497-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Created reservations ['f51561be-9df1-4ebe-b126-888be3da6ea1', '2768a97b-e8cd-47ec-8016-89fb02a06dda', 'fcb85cf3-2fb5-4d98-ae86-84415c5d8b91', '8617f606-ba22-4e7c-820e-1f7d5b6500e5'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Delete snapshot completed successfully. Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5a3764c6-d759-417b-ae5c-31254b399270 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-c843d398-9dd8-4aab-9495-5d28ae60a4f4-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "cinder-40dd3929-0594-494d-9f1c-a95607a7b432-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-40dd3929-0594-494d-9f1c-a95607a7b432-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "cinder-quobyte-40dd3929-0594-494d-9f1c-a95607a7b432" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-quobyte-40dd3929-0594-494d-9f1c-a95607a7b432" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (1ca22eab-611c-4cc7-8f94-5538aa63f181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8535ca7-1e23-4151-b3be-446c15aa9831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0356e1-88d3-4812-b8c1-a26e37f8e2a3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8535ca7-1e23-4151-b3be-446c15aa9831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1338200318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6732ad-431a-4b71-a624-36c8f0d739d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:56Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d364c5d-0e97-4161-8c73-a09b1435219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d364c5d-0e97-4161-8c73-a09b1435219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767ff8d5-88e9-4b89-b51e-ba8f93d6c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767ff8d5-88e9-4b89-b51e-ba8f93d6c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6732ad-431a-4b71-a624-36c8f0d739d4', 'volume_name': 'volume-7e6732ad-431a-4b71-a624-36c8f0d739d4', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68b6aa8-ae69-479a-9f69-32ce5996ea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68b6aa8-ae69-479a-9f69-32ce5996ea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57609f42-431c-4e3b-853c-d3762a1cae0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:56 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Volume 7e6732ad-431a-4b71-a624-36c8f0d739d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6732ad-431a-4b71-a624-36c8f0d739d4', 'volume_size': 1} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1338200318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6732ad-431a-4b71-a624-36c8f0d739d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:35:56Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Creating volume 7e6732ad-431a-4b71-a624-36c8f0d739d4 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:35:56 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:56 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 1073741824 Sep 11 21:35:56 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:56 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 Sep 11 21:35:56 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:56 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432" returned: 0 in 0.384s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:57 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432 Sep 11 21:35:57 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:57 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 1073741824" returned: 0 in 0.418s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:57 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 Sep 11 21:35:57 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:57 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-40dd3929-0594-494d-9f1c-a95607a7b432" returned: 0 in 0.262s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-quobyte-40dd3929-0594-494d-9f1c-a95607a7b432" released by "delete_volume" :: held 0.733s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Created reservations ['78816246-9ee9-4a28-80f5-f84d16e0bdf5', 'c03edb6e-6dbf-48ab-8742-edba30944da9', '7639c42e-6801-446b-98d5-c2586755c562', '9b292f89-b322-46c3-bde8-e11a21d1df79'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:57 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4" returned: 0 in 0.273s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:57 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57609f42-431c-4e3b-853c-d3762a1cae0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6732ad-431a-4b71-a624-36c8f0d739d4', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:57 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d569bc-b5d0-466e-ae6b-fd5a9b6f297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:35:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Volume volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 (7e6732ad-431a-4b71-a624-36c8f0d739d4): created successfully Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d569bc-b5d0-466e-ae6b-fd5a9b6f297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (1ca22eab-611c-4cc7-8f94-5538aa63f181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:35:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fc38b52f-016f-41f7-bb8f-4e12738bdf78 tempest-VolumesActionsTest-1394967502 None] Created volume successfully. Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "cinder-52f2dbba-6f25-47cc-9580-6dfcefaa415f-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-52f2dbba-6f25-47cc-9580-6dfcefaa415f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:57 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "cinder-quobyte-52f2dbba-6f25-47cc-9580-6dfcefaa415f" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.306s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Deleted volume successfully. Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-quobyte-52f2dbba-6f25-47cc-9580-6dfcefaa415f" acquired by "delete_volume" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-13db5b44-5d63-449f-a91c-65aa57f49421 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-40dd3929-0594-494d-9f1c-a95607a7b432-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4d84d1-36ed-43d7-b3f5-d2ac9a2ac48d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:57 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f Sep 11 21:35:57 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:58 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f" returned: 0 in 0.355s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:58 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f Sep 11 21:35:58 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:58 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52f2dbba-6f25-47cc-9580-6dfcefaa415f" returned: 0 in 0.243s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-quobyte-52f2dbba-6f25-47cc-9580-6dfcefaa415f" released by "delete_volume" :: held 0.641s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Created reservations ['d945be38-02e7-4ca3-a8b7-75f5faffa61c', 'f728d589-6b58-496b-8769-862df260c78b', 'ff96579c-6615-4955-b6b9-1ae913d90fc7', 'afb3a86a-a7a7-4101-853f-7767272ae8a9'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:58 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:58 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "cinder-7e6732ad-431a-4b71-a624-36c8f0d739d4-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:58 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-7e6732ad-431a-4b71-a624-36c8f0d739d4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.287s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:35:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Deleted volume successfully. Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e8e1621e-1f79-4048-94e5-b4beff1bda18 tempest-CinderUnicodeTest-316806202 None] Lock "cinder-52f2dbba-6f25-47cc-9580-6dfcefaa415f-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "cinder-quobyte-7e6732ad-431a-4b71-a624-36c8f0d739d4" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-quobyte-7e6732ad-431a-4b71-a624-36c8f0d739d4" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[282032d8-ff4c-41d4-b529-9d22cb08e3b4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:35:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:59 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 Sep 11 21:35:59 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:59 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4" returned: 0 in 0.391s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:59 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4 Sep 11 21:35:59 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:35:59 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7e6732ad-431a-4b71-a624-36c8f0d739d4" returned: 0 in 0.290s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-quobyte-7e6732ad-431a-4b71-a624-36c8f0d739d4" released by "delete_volume" :: held 0.733s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Created reservations ['bb616431-1893-4fc3-9036-5ebc0f9dfd28', '66a71eb9-951c-4bfc-831e-295286838e09', '5e304134-cf5c-45b4-8201-490ec279d299', '1d74fa7a-41fb-402c-96ee-2ad170875311'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:35:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:35:59 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:35:59 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:00 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.288s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:00 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Deleted volume successfully. Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e4dd7e17-c3c6-4690-9c46-a40f35bb8720 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-7e6732ad-431a-4b71-a624-36c8f0d739d4-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (19fb589c-7e3f-4259-bb5c-a93b32d1458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f9ea8c-c25c-46e7-8910-dc4b4f1fcb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f9ea8c-c25c-46e7-8910-dc4b4f1fcb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1121663928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08351545-0c57-4b45-b21f-7a94fe2437bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:00Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef390d31-f41b-460d-9ad4-06074bbbaaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef390d31-f41b-460d-9ad4-06074bbbaaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (131b2a4f-890d-4788-8511-4e7a784f2840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (131b2a4f-890d-4788-8511-4e7a784f2840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08351545-0c57-4b45-b21f-7a94fe2437bc', 'volume_name': 'volume-08351545-0c57-4b45-b21f-7a94fe2437bc', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb6419b-06c9-4515-ae21-18021754a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb6419b-06c9-4515-ae21-18021754a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bcdb3d-6f56-4432-9748-f2922b68bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:00 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Volume 08351545-0c57-4b45-b21f-7a94fe2437bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08351545-0c57-4b45-b21f-7a94fe2437bc', 'volume_size': 1} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1121663928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08351545-0c57-4b45-b21f-7a94fe2437bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:00Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Creating volume 08351545-0c57-4b45-b21f-7a94fe2437bc {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:00 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:00 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc 1073741824 Sep 11 21:36:00 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:01 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc 1073741824" returned: 0 in 0.478s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:01 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc Sep 11 21:36:01 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:01 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc" returned: 0 in 0.275s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bcdb3d-6f56-4432-9748-f2922b68bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08351545-0c57-4b45-b21f-7a94fe2437bc', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134c49ca-ed1c-4ad4-a5c2-a4cec201016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:01 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Volume volume-08351545-0c57-4b45-b21f-7a94fe2437bc (08351545-0c57-4b45-b21f-7a94fe2437bc): created successfully Sep 11 21:36:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134c49ca-ed1c-4ad4-a5c2-a4cec201016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (19fb589c-7e3f-4259-bb5c-a93b32d1458c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d8317887-b70f-4978-89f2-bfd470eceda9 tempest-VolumesActionsTest-1394967502 None] Created volume successfully. Sep 11 21:36:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "cinder-08351545-0c57-4b45-b21f-7a94fe2437bc-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-08351545-0c57-4b45-b21f-7a94fe2437bc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "cinder-quobyte-08351545-0c57-4b45-b21f-7a94fe2437bc" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-quobyte-08351545-0c57-4b45-b21f-7a94fe2437bc" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:02 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c843e867-710e-4918-b0bd-445e20e8950c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:02 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc Sep 11 21:36:02 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:03 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc" returned: 0 in 0.387s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:03 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc Sep 11 21:36:03 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:03 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-08351545-0c57-4b45-b21f-7a94fe2437bc" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-quobyte-08351545-0c57-4b45-b21f-7a94fe2437bc" released by "delete_volume" :: held 0.702s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Created reservations ['62b34452-bf06-4462-8817-1b88dd587456', 'cbd5c5af-daa1-4451-a229-76c0859490e6', 'e14c827a-6794-45f5-8db5-64d931bf123c', 'fc43b3c1-a49d-4d25-9f16-a1e41fee6928'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:03 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:03 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:04 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.285s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Deleted volume successfully. Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81f03730-6aa8-45b6-912f-f562e28e3949 tempest-VolumesActionsTest-1850223508 None] Lock "cinder-08351545-0c57-4b45-b21f-7a94fe2437bc-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (700a70c3-2a41-40e2-aa9d-1a6883726261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afee783-952c-4fae-94a9-3133a0931ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afee783-952c-4fae-94a9-3133a0931ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-307799076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f913984c-10f8-4424-b398-52d5a5e263e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:04Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44612a0-9e46-4a76-a114-69f95d6ef1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44612a0-9e46-4a76-a114-69f95d6ef1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06d0f6d-a1e8-45e0-8c19-986415547df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06d0f6d-a1e8-45e0-8c19-986415547df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f913984c-10f8-4424-b398-52d5a5e263e1', 'volume_name': 'volume-f913984c-10f8-4424-b398-52d5a5e263e1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f30bb-3dc5-4883-bf17-ff27410892a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f30bb-3dc5-4883-bf17-ff27410892a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e20987-8b93-4246-b7c4-c73d308536ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Volume f913984c-10f8-4424-b398-52d5a5e263e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f913984c-10f8-4424-b398-52d5a5e263e1', 'volume_size': 1} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-307799076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f913984c-10f8-4424-b398-52d5a5e263e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b989449d396a4d43935b4ff7fe60c177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:04Z,use_quota=True,user_id='84b80152b6d74da982535766158cd8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Creating volume f913984c-10f8-4424-b398-52d5a5e263e1 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:04 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:04 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1 1073741824 Sep 11 21:36:04 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:05 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1 1073741824" returned: 0 in 0.479s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:05 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1 Sep 11 21:36:05 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:05 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1" returned: 0 in 0.266s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e20987-8b93-4246-b7c4-c73d308536ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f913984c-10f8-4424-b398-52d5a5e263e1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68960ef9-84fa-476c-af6a-9298bb9d5bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:05 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Volume volume-f913984c-10f8-4424-b398-52d5a5e263e1 (f913984c-10f8-4424-b398-52d5a5e263e1): created successfully Sep 11 21:36:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68960ef9-84fa-476c-af6a-9298bb9d5bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Flow 'volume_create_manager' (700a70c3-2a41-40e2-aa9d-1a6883726261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0871189e-5e96-4d43-9f32-66d295f5addd tempest-VolumesActionsTest-1394967502 None] Created volume successfully. Sep 11 21:36:06 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Flow 'volume_create_manager' (39251177-55bc-4381-a630-881085dc4e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8feba27-7f1d-486d-871d-6d8da56518f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8feba27-7f1d-486d-871d-6d8da56518f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123812398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a26aad-31bf-4cb5-8f07-f77258953dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5706ff1dc3c4af4ab8973bbc7d4ac5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:07Z,use_quota=True,user_id='9c4c84623ce4430da4f00c347eec529f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b3fbbb-9c2a-4aaa-bcaa-6df11c7bee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b3fbbb-9c2a-4aaa-bcaa-6df11c7bee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37eeebe-7227-43c0-a02b-0d1c879a1372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37eeebe-7227-43c0-a02b-0d1c879a1372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a26aad-31bf-4cb5-8f07-f77258953dde', 'volume_name': 'volume-10a26aad-31bf-4cb5-8f07-f77258953dde', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190a28eb-c409-42a4-b3a6-c2e44eccaadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190a28eb-c409-42a4-b3a6-c2e44eccaadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc5c6d6-0e04-4950-b028-45090bf1bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Volume 10a26aad-31bf-4cb5-8f07-f77258953dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a26aad-31bf-4cb5-8f07-f77258953dde', 'volume_size': 1} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123812398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a26aad-31bf-4cb5-8f07-f77258953dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5706ff1dc3c4af4ab8973bbc7d4ac5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:07Z,use_quota=True,user_id='9c4c84623ce4430da4f00c347eec529f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Creating volume 10a26aad-31bf-4cb5-8f07-f77258953dde {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:07 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:07 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde 1073741824 Sep 11 21:36:07 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Acquiring lock "cinder-f913984c-10f8-4424-b398-52d5a5e263e1-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Lock "cinder-f913984c-10f8-4424-b398-52d5a5e263e1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Acquiring lock "cinder-quobyte-f913984c-10f8-4424-b398-52d5a5e263e1" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Lock "cinder-quobyte-f913984c-10f8-4424-b398-52d5a5e263e1" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd9ef13-15b8-40e0-b1f2-de237e8e7630]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:07 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1 Sep 11 21:36:07 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:07 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde 1073741824" returned: 0 in 0.453s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:07 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde Sep 11 21:36:07 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:07 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1" returned: 0 in 0.359s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:07 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1 Sep 11 21:36:07 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:07 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde" returned: 0 in 0.265s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc5c6d6-0e04-4950-b028-45090bf1bd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a26aad-31bf-4cb5-8f07-f77258953dde', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a195775-5335-4513-9f7a-1d693d4b1895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Volume volume-10a26aad-31bf-4cb5-8f07-f77258953dde (10a26aad-31bf-4cb5-8f07-f77258953dde): created successfully Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a195775-5335-4513-9f7a-1d693d4b1895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Flow 'volume_create_manager' (39251177-55bc-4381-a630-881085dc4e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-203e1c84-6962-4575-b5f8-9e763e9b8a81 tempest-ProjectReaderTests-214291422 None] Created volume successfully. Sep 11 21:36:07 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f913984c-10f8-4424-b398-52d5a5e263e1" returned: 0 in 0.276s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Lock "cinder-quobyte-f913984c-10f8-4424-b398-52d5a5e263e1" released by "delete_volume" :: held 0.681s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:07 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Created reservations ['309c612f-fa59-4b7c-ac58-a8ef3f9cf3b8', '91df6b76-bd9b-45c6-9ed9-20258a3df721', 'e057ac34-987c-4c10-9ef1-9e7a78249275', '3d9039dc-ad8d-4f16-ab2e-ecf1d52a0f31'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:08 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:08 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Acquiring lock "cinder-10a26aad-31bf-4cb5-8f07-f77258953dde-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Lock "cinder-10a26aad-31bf-4cb5-8f07-f77258953dde-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Acquiring lock "cinder-quobyte-10a26aad-31bf-4cb5-8f07-f77258953dde" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Lock "cinder-quobyte-10a26aad-31bf-4cb5-8f07-f77258953dde" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[96832f23-6723-4852-84ea-faaa1da41d78]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:08 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.274s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:08 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Deleted volume successfully. Sep 11 21:36:08 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde Sep 11 21:36:08 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d7880b16-8d08-4d0d-9b7e-c587b3f7ecba tempest-VolumesActionsTest-1394967502 None] Lock "cinder-f913984c-10f8-4424-b398-52d5a5e263e1-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:08 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde" returned: 0 in 0.387s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:08 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde Sep 11 21:36:08 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:08 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-10a26aad-31bf-4cb5-8f07-f77258953dde" returned: 0 in 0.276s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Lock "cinder-quobyte-10a26aad-31bf-4cb5-8f07-f77258953dde" released by "delete_volume" :: held 0.702s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:08 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Created reservations ['07805722-d9c5-4216-90dd-6b3beebf9929', '1d53e0a2-4a62-44f3-a6bd-b9edd26736d5', '236849e1-b092-4b5c-8aad-771eb2e57017', '025c14e0-2840-4bdb-9b96-ef38d94a91c6'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:09 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:09 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:09 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.284s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Deleted volume successfully. Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e9c244ce-6417-4e1b-9078-a753aa00f565 tempest-ProjectReaderTests-214291422 None] Lock "cinder-10a26aad-31bf-4cb5-8f07-f77258953dde-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Flow 'volume_create_manager' (7ab32be4-4d97-4454-82cd-0db3d6a02e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b519d9b1-9482-43bc-af5d-47e6c84fe0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b519d9b1-9482-43bc-af5d-47e6c84fe0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2019401659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd92a2b-c97d-48f7-b992-3f6bc02b4848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5706ff1dc3c4af4ab8973bbc7d4ac5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:10Z,use_quota=True,user_id='9c4c84623ce4430da4f00c347eec529f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ca32ce-c613-4ecf-a1b7-100049652054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ca32ce-c613-4ecf-a1b7-100049652054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9108c5-d36d-47da-ac18-cf59e0e6b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9108c5-d36d-47da-ac18-cf59e0e6b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd92a2b-c97d-48f7-b992-3f6bc02b4848', 'volume_name': 'volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392328bd-157a-4096-b3ca-01f138c982ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392328bd-157a-4096-b3ca-01f138c982ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1d53a7-e720-4c3d-9aea-e444fbd753c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:09 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Volume 0bd92a2b-c97d-48f7-b992-3f6bc02b4848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848', 'volume_size': 1} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2019401659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd92a2b-c97d-48f7-b992-3f6bc02b4848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5706ff1dc3c4af4ab8973bbc7d4ac5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:10Z,use_quota=True,user_id='9c4c84623ce4430da4f00c347eec529f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Creating volume 0bd92a2b-c97d-48f7-b992-3f6bc02b4848 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:09 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:10 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 1073741824 Sep 11 21:36:10 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:10 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 1073741824" returned: 0 in 0.473s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:10 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 Sep 11 21:36:10 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:10 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848" returned: 0 in 0.410s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1d53a7-e720-4c3d-9aea-e444fbd753c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401b6fa9-86a7-4624-8b26-25c5f0b1d797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:10 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Volume volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 (0bd92a2b-c97d-48f7-b992-3f6bc02b4848): created successfully Sep 11 21:36:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401b6fa9-86a7-4624-8b26-25c5f0b1d797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Flow 'volume_create_manager' (7ab32be4-4d97-4454-82cd-0db3d6a02e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-01696863-a669-4bcf-a661-950fbafdb4a2 tempest-ProjectReaderTests-214291422 None] Created volume successfully. Sep 11 21:36:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Acquiring lock "cinder-0bd92a2b-c97d-48f7-b992-3f6bc02b4848-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Lock "cinder-0bd92a2b-c97d-48f7-b992-3f6bc02b4848-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Acquiring lock "cinder-quobyte-0bd92a2b-c97d-48f7-b992-3f6bc02b4848" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Lock "cinder-quobyte-0bd92a2b-c97d-48f7-b992-3f6bc02b4848" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f597c94-6d95-4e62-a10f-f60c7eab40b6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:12 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 Sep 11 21:36:12 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:12 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848" returned: 0 in 0.558s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:12 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848 Sep 11 21:36:12 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-8aa6a51e-b922-4744-a4ef-37c5d94f2df2 tempest-TestShelveInstance-1274408701 None] Terminate volume connection completed successfully. Sep 11 21:36:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-8aa6a51e-b922-4744-a4ef-37c5d94f2df2 tempest-TestShelveInstance-1274408701 None] Deleting attachment c00d9f3b-c28a-441f-bba2-6623c885e799. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:36:13 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-0bd92a2b-c97d-48f7-b992-3f6bc02b4848" returned: 0 in 0.309s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Lock "cinder-quobyte-0bd92a2b-c97d-48f7-b992-3f6bc02b4848" released by "delete_volume" :: held 0.921s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Created reservations ['c47110c9-f830-4d9b-8aa7-3a0b674c505b', 'e7632688-d659-4770-8036-03aef3ee9f1a', '6d015e1f-0862-40c5-8d71-68565f4692f9', 'beb8545e-79fd-49a4-8f3c-ee78de77b188'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Acquiring lock "cinder-7806e06f-9f99-42ae-bcba-6191ddbfe7ab-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:13 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:13 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Lock "cinder-7806e06f-9f99-42ae-bcba-6191ddbfe7ab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Acquiring lock "cinder-quobyte-7806e06f-9f99-42ae-bcba-6191ddbfe7ab" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Lock "cinder-quobyte-7806e06f-9f99-42ae-bcba-6191ddbfe7ab" acquired by "delete_volume" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bfd082-28e7-4df7-b619-d50f69eadde6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:13 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab Sep 11 21:36:13 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:13 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.353s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:13 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Deleted volume successfully. Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-bfe66af0-499c-4326-99fb-1beea4a69466 tempest-ProjectReaderTests-214291422 None] Lock "cinder-0bd92a2b-c97d-48f7-b992-3f6bc02b4848-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:13 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab" returned: 0 in 0.592s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:13 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab Sep 11 21:36:13 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Flow 'volume_create_manager' (0624b50f-4653-4989-b833-ba7d4d5c3cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7323bec-469e-43da-9df7-14e487b28ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7323bec-469e-43da-9df7-14e487b28ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415590554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9717a3f1-5a8d-4e50-be24-a7b6732391b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5706ff1dc3c4af4ab8973bbc7d4ac5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:14Z,use_quota=True,user_id='9c4c84623ce4430da4f00c347eec529f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6a9484-fedf-40c7-9a6e-51ac97857e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6a9484-fedf-40c7-9a6e-51ac97857e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338463fe-5637-45bd-a616-295e0b23cc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338463fe-5637-45bd-a616-295e0b23cc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9717a3f1-5a8d-4e50-be24-a7b6732391b4', 'volume_name': 'volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643589d7-cf05-4b17-92e3-4c3cc8f07564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643589d7-cf05-4b17-92e3-4c3cc8f07564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efad3f8-2185-4c0d-bb21-73f0b9893f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:14 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Volume 9717a3f1-5a8d-4e50-be24-a7b6732391b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4', 'volume_size': 1} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415590554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9717a3f1-5a8d-4e50-be24-a7b6732391b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5706ff1dc3c4af4ab8973bbc7d4ac5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:14Z,use_quota=True,user_id='9c4c84623ce4430da4f00c347eec529f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Creating volume 9717a3f1-5a8d-4e50-be24-a7b6732391b4 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:14 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:14 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 1073741824 Sep 11 21:36:14 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:14 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7806e06f-9f99-42ae-bcba-6191ddbfe7ab" returned: 0 in 0.308s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Lock "cinder-quobyte-7806e06f-9f99-42ae-bcba-6191ddbfe7ab" released by "delete_volume" :: held 0.967s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.quota [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Created reservations ['fa84026f-a62b-49f0-804c-f2ea1c86226d', '649f6a08-6236-4bf3-98de-47bcb59d503d', '04f29d8f-ce3a-4a89-aa30-baa71ed2ccc0', '2b6b49e6-0e4b-435b-a789-1ccc1792f2bb'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:14 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:14 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:14 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:14 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.281s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.manager [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 1073741824" returned: 0 in 0.509s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:14 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Deleted volume successfully. Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [req-2c2dab00-943d-4c8e-a4a0-ab93943e7df0 req-3a5c88bb-b72c-482a-be70-1d2f787a59f6 tempest-TestShelveInstance-1274408701 None] Lock "cinder-7806e06f-9f99-42ae-bcba-6191ddbfe7ab-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:14 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 Sep 11 21:36:14 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:15 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4" returned: 0 in 0.303s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efad3f8-2185-4c0d-bb21-73f0b9893f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e37ff5-d695-4387-83d1-c5b7f1b9ad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:15 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Volume volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 (9717a3f1-5a8d-4e50-be24-a7b6732391b4): created successfully Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e37ff5-d695-4387-83d1-c5b7f1b9ad1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Flow 'volume_create_manager' (0624b50f-4653-4989-b833-ba7d4d5c3cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:15 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8bb2213e-2d99-4ecb-84da-e2e27bce283e tempest-ProjectReaderTests-214291422 None] Created volume successfully. Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:15 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:15 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:16 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.326s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Acquiring lock "cinder-9717a3f1-5a8d-4e50-be24-a7b6732391b4-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Lock "cinder-9717a3f1-5a8d-4e50-be24-a7b6732391b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Acquiring lock "cinder-quobyte-9717a3f1-5a8d-4e50-be24-a7b6732391b4" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Lock "cinder-quobyte-9717a3f1-5a8d-4e50-be24-a7b6732391b4" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ebe4de-dd34-494e-b9e8-d83af6668970]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:16 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 Sep 11 21:36:16 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:16 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4" returned: 0 in 0.459s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:16 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4 Sep 11 21:36:16 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:17 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9717a3f1-5a8d-4e50-be24-a7b6732391b4" returned: 0 in 0.284s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Lock "cinder-quobyte-9717a3f1-5a8d-4e50-be24-a7b6732391b4" released by "delete_volume" :: held 0.790s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Created reservations ['32ba082d-ec05-4204-9757-01163430e1c1', '2007d7bf-8b08-4ac8-8850-f40bb4de841f', 'ece60aed-7378-4f90-aba9-3d29e45cc6d7', '1e78b204-3bad-490d-89c7-2f87d441a133'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:17 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:17 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:17 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.344s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Deleted volume successfully. Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7d1300eb-96d1-4cb9-a476-a75b9427ab2f tempest-ProjectReaderTests-214291422 None] Lock "cinder-9717a3f1-5a8d-4e50-be24-a7b6732391b4-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Flow 'volume_create_manager' (37e16409-4117-44e7-a0b1-9f2649307483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09b6421-848d-448b-9512-a8f25933b527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09b6421-848d-448b-9512-a8f25933b527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-550154343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955517b3-e57b-467a-b0a4-0f6cf5122a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5706ff1dc3c4af4ab8973bbc7d4ac5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:18Z,use_quota=True,user_id='9c4c84623ce4430da4f00c347eec529f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84df850b-818f-4b4b-8fa8-26eb43569901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84df850b-818f-4b4b-8fa8-26eb43569901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab12e57-e7e3-4e25-bdb7-13a608ae00bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab12e57-e7e3-4e25-bdb7-13a608ae00bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955517b3-e57b-467a-b0a4-0f6cf5122a2c', 'volume_name': 'volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c5866c-8bfb-4f1f-8919-52d2da780ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c5866c-8bfb-4f1f-8919-52d2da780ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfd3402-2d75-4787-ac1e-4f4bd527dd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:18 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Volume 955517b3-e57b-467a-b0a4-0f6cf5122a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c', 'volume_size': 1} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-550154343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955517b3-e57b-467a-b0a4-0f6cf5122a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5706ff1dc3c4af4ab8973bbc7d4ac5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:18Z,use_quota=True,user_id='9c4c84623ce4430da4f00c347eec529f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Creating volume 955517b3-e57b-467a-b0a4-0f6cf5122a2c {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:18 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:18 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c 1073741824 Sep 11 21:36:18 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:18 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c 1073741824" returned: 0 in 0.454s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:18 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c Sep 11 21:36:18 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:18 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c" returned: 0 in 0.314s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfd3402-2d75-4787-ac1e-4f4bd527dd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7bd617-e607-4da3-8b8d-70e392a4c0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:18 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Volume volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c (955517b3-e57b-467a-b0a4-0f6cf5122a2c): created successfully Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7bd617-e607-4da3-8b8d-70e392a4c0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Flow 'volume_create_manager' (37e16409-4117-44e7-a0b1-9f2649307483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:18 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8bb10842-c0f0-48d9-b87f-4fca896888dd tempest-ProjectReaderTests-214291422 None] Created volume successfully. Sep 11 21:36:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Acquiring lock "cinder-955517b3-e57b-467a-b0a4-0f6cf5122a2c-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Lock "cinder-955517b3-e57b-467a-b0a4-0f6cf5122a2c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Acquiring lock "cinder-quobyte-955517b3-e57b-467a-b0a4-0f6cf5122a2c" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Lock "cinder-quobyte-955517b3-e57b-467a-b0a4-0f6cf5122a2c" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[008619bc-ebed-4d14-bf46-d972257a3b1d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:20 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c Sep 11 21:36:20 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:20 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c" returned: 0 in 0.419s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:20 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c Sep 11 21:36:20 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:21 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-955517b3-e57b-467a-b0a4-0f6cf5122a2c" returned: 0 in 0.378s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Lock "cinder-quobyte-955517b3-e57b-467a-b0a4-0f6cf5122a2c" released by "delete_volume" :: held 0.858s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Created reservations ['5d687d38-c000-4ec5-8159-9a26886800a4', '4194b68e-e266-4940-bc92-c71cff628607', 'b84135a0-5a20-4beb-a19a-4264a948dbd3', '5b6a1029-4789-419d-ab48-7286c8499144'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:21 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:21 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:21 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.364s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Deleted volume successfully. Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=146,cinder:UPDATE=171,cinder:INSERT=41,cinder:DELETE=10 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:36:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-94b57cae-b0da-4eb2-ab28-ca17395c0194 tempest-ProjectReaderTests-214291422 None] Lock "cinder-955517b3-e57b-467a-b0a4-0f6cf5122a2c-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Flow 'volume_create_manager' (86b608eb-c1de-4b3b-894c-d4562c5594d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79309a45-7b78-467d-9c53-a29472bb016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=122,cinder:DELETE=20,cinder:UPDATE=184,cinder:INSERT=44 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79309a45-7b78-467d-9c53-a29472bb016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1022873163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cbf5d7-026b-485f-b92e-ea625d84997e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c34b01959d4c4a8df07212911961fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:26Z,use_quota=True,user_id='3b91fc1c004a4469add9d26dce58a81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004a61a4-6acc-4f2c-8ace-9cd0e3424b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004a61a4-6acc-4f2c-8ace-9cd0e3424b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3556dbe-4afa-4189-9af1-11fc7fb7b482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3556dbe-4afa-4189-9af1-11fc7fb7b482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cbf5d7-026b-485f-b92e-ea625d84997e', 'volume_name': 'volume-95cbf5d7-026b-485f-b92e-ea625d84997e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ff4b55-d6a2-4aad-a206-da7837b57037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ff4b55-d6a2-4aad-a206-da7837b57037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ffc999-d085-4b8e-85bb-159c8d61feb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:25 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Volume 95cbf5d7-026b-485f-b92e-ea625d84997e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cbf5d7-026b-485f-b92e-ea625d84997e', 'volume_size': 1} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1022873163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cbf5d7-026b-485f-b92e-ea625d84997e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c34b01959d4c4a8df07212911961fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:26Z,use_quota=True,user_id='3b91fc1c004a4469add9d26dce58a81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Creating volume 95cbf5d7-026b-485f-b92e-ea625d84997e {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:25 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:25 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e 1073741824 Sep 11 21:36:25 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:26 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e 1073741824" returned: 0 in 0.459s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:26 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e Sep 11 21:36:26 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:26 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e" returned: 0 in 0.274s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ffc999-d085-4b8e-85bb-159c8d61feb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cbf5d7-026b-485f-b92e-ea625d84997e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4367ad-de04-45ff-8f65-6791db72713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:26 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Volume volume-95cbf5d7-026b-485f-b92e-ea625d84997e (95cbf5d7-026b-485f-b92e-ea625d84997e): created successfully Sep 11 21:36:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4367ad-de04-45ff-8f65-6791db72713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Flow 'volume_create_manager' (86b608eb-c1de-4b3b-894c-d4562c5594d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:26 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b439c7cf-5912-4496-8f18-621942c811ee tempest-SnapshotMetadataTestJSON-1514128492 None] Created volume successfully. Sep 11 21:36:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Creating offline snapshot 688d7d06-3b8e-440f-a312-2b578b0beca9 of volume 95cbf5d7-026b-485f-b92e-ea625d84997e {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:36:28 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[39878702-0ce6-49bb-9afb-67b43d74306c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:28 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e Sep 11 21:36:28 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:28 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e" returned: 0 in 0.361s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:28 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 1G Sep 11 21:36:28 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:28 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 1G" returned: 0 in 0.400s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cbf5d7-026b-485f-b92e-ea625d84997e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:28 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cbf5d7-026b-485f-b92e-ea625d84997e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 Sep 11 21:36:28 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:29 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cbf5d7-026b-485f-b92e-ea625d84997e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9" returned: 0 in 0.299s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:29 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 is being set with open permissions: ugo+rw Sep 11 21:36:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:29 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 Sep 11 21:36:29 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:29 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9" returned: 0 in 0.258s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:29 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.info Sep 11 21:36:29 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:29 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.info" returned: 0 in 0.270s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:29 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.info is being set with open permissions: ugo+rw Sep 11 21:36:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:29 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.info Sep 11 21:36:29 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:29 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.info" returned: 0 in 0.287s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:30 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-52ec4b1f-6de1-4bf8-ad79-6947ba2f4c11 tempest-SnapshotMetadataTestJSON-1514128492 None] Create snapshot completed successfully Sep 11 21:36:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Acquiring lock "cinder-688d7d06-3b8e-440f-a312-2b578b0beca9-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-688d7d06-3b8e-440f-a312-2b578b0beca9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Acquiring lock "cinder-quobyte-95cbf5d7-026b-485f-b92e-ea625d84997e" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-quobyte-95cbf5d7-026b-485f-b92e-ea625d84997e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Acquiring lock "cinder-quobyte-688d7d06-3b8e-440f-a312-2b578b0beca9" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-quobyte-688d7d06-3b8e-440f-a312-2b578b0beca9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Deleting offline snapshot 688d7d06-3b8e-440f-a312-2b578b0beca9 of volume 95cbf5d7-026b-485f-b92e-ea625d84997e {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] snapshot_file for this snap is: volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebca8bb-3a75-414e-b76d-cb1a614753f3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:31 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 Sep 11 21:36:31 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:31 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9" returned: 0 in 0.377s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95cbf5d7-026b-485f-b92e-ea625d84997e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9c2c5-0dda-4ce7-b52f-e9bdd2fc0deb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:31 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e Sep 11 21:36:31 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:31 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e" returned: 0 in 0.374s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:31 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 Sep 11 21:36:31 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:32 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9" returned: 0 in 0.357s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:32 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9 Sep 11 21:36:32 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:32 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e.688d7d06-3b8e-440f-a312-2b578b0beca9" returned: 0 in 0.253s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-quobyte-688d7d06-3b8e-440f-a312-2b578b0beca9" released by "_delete_snapshot" :: held 1.484s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-quobyte-95cbf5d7-026b-485f-b92e-ea625d84997e" released by "delete_snapshot" :: held 1.510s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Created reservations ['a92971b3-1def-489c-bb8e-e07054cd54f8', 'f82914e5-4cc7-487c-aa01-3837a6e58b81', '593a9eb4-e7f4-47da-9eef-a588163ff688', 'e98e2500-f3de-4aaf-8f72-077be4446e00'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:32 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Delete snapshot completed successfully. Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e2f14c02-e952-4fda-8712-c862b2fbb126 tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-688d7d06-3b8e-440f-a312-2b578b0beca9-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Flow 'volume_create_manager' (b78fea2b-f781-43d4-bbc1-dfd7a0ab8dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ae6099-f85d-405e-b831-43d52c5ff317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ae6099-f85d-405e-b831-43d52c5ff317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982fbe44-47db-4121-84c5-8da2c2f3ac37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee1de9cbce3492cb1daca01cd3e677a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:33Z,use_quota=True,user_id='d53f6b3624b04097a08f23aac5b10e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(426d15b3-add4-47d1-8fba-c570237d6afc),volume_type_id=426d15b3-add4-47d1-8fba-c570237d6afc)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98645b15-f4e8-4811-8826-a35ea9748a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98645b15-f4e8-4811-8826-a35ea9748a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eef0c67-6a4e-47eb-9749-50f93c562723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eef0c67-6a4e-47eb-9749-50f93c562723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '982fbe44-47db-4121-84c5-8da2c2f3ac37', 'volume_name': 'volume-982fbe44-47db-4121-84c5-8da2c2f3ac37', 'volume_size': 1, 'image_id': 'f12b3735-79dc-4345-8606-362965b0a4df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12b3735-79dc-4345-8606-362965b0a4df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3e6efd7cf5925903ad8e7fb01aefe78', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bee1de9cbce3492cb1daca01cd3e677a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc18f2a685cbd517addd278649cc69dfe775a3dd47f2c238badaca7ab341b10c02f63eb0d4904e4ce8635a3a1512ea5a9b4b29842eeef8c3f0e2688e9df06014', 'id': 'f12b3735-79dc-4345-8606-362965b0a4df', 'created_at': datetime.datetime(2026, 9, 11, 19, 36, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12b3735-79dc-4345-8606-362965b0a4df/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6ac99a-7a38-42c1-b6fa-b8c65dbea9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6ac99a-7a38-42c1-b6fa-b8c65dbea9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66ddae7-2b4a-454a-8d86-b3d351792786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:33 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Volume 982fbe44-47db-4121-84c5-8da2c2f3ac37: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-982fbe44-47db-4121-84c5-8da2c2f3ac37', 'volume_size': 1, 'image_id': 'f12b3735-79dc-4345-8606-362965b0a4df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12b3735-79dc-4345-8606-362965b0a4df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3e6efd7cf5925903ad8e7fb01aefe78', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bee1de9cbce3492cb1daca01cd3e677a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc18f2a685cbd517addd278649cc69dfe775a3dd47f2c238badaca7ab341b10c02f63eb0d4904e4ce8635a3a1512ea5a9b4b29842eeef8c3f0e2688e9df06014', 'id': 'f12b3735-79dc-4345-8606-362965b0a4df', 'created_at': datetime.datetime(2026, 9, 11, 19, 36, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12b3735-79dc-4345-8606-362965b0a4df/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Trying to clone 982fbe44-47db-4121-84c5-8da2c2f3ac37 from image f12b3735-79dc-4345-8606-362965b0a4df at location (None, [{'url': 'file:///opt/stack/data/glance/images/f12b3735-79dc-4345-8606-362965b0a4df', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:36:33 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Image download 0.00 MB at 0.00 MB/s Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2851a8-3eb4-4e3c-9422-4c960508434e]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Acquiring lock "cinder-95cbf5d7-026b-485f-b92e-ea625d84997e-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-95cbf5d7-026b-485f-b92e-ea625d84997e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Acquiring lock "cinder-quobyte-95cbf5d7-026b-485f-b92e-ea625d84997e" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:33 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD Sep 11 21:36:33 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-quobyte-95cbf5d7-026b-485f-b92e-ea625d84997e" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f4c1f5-5fa1-4047-b58a-33635bd60a54]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:33 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e Sep 11 21:36:33 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:33 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:33 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD Sep 11 21:36:33 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:33 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e" returned: 0 in 0.384s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:33 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e Sep 11 21:36:33 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:33 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Temporary image f12b3735-79dc-4345-8606-362965b0a4df is fetched for user d53f6b3624b04097a08f23aac5b10e14. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[09599821-85f4-48bb-b4cd-fd14a60ed5f2]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:33 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95cbf5d7-026b-485f-b92e-ea625d84997e" returned: 0 in 0.247s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-quobyte-95cbf5d7-026b-485f-b92e-ea625d84997e" released by "delete_volume" :: held 0.693s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Created reservations ['5fe4bf76-3fc6-4db4-9316-8808d6eae4a6', 'dedc2269-641d-4b4e-9d54-c17f1d5c441b', '47324eb8-67ca-4110-a5a8-5d2b9b726a89', '59509caa-8a29-42f1-9ab3-6f0cfcc34c54'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:34 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD Sep 11 21:36:34 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:34 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:34 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:34 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:34 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.257s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Deleted volume successfully. Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-34316f72-cf5c-4453-aa59-261da89a3bfa tempest-SnapshotMetadataTestJSON-1514128492 None] Lock "cinder-95cbf5d7-026b-485f-b92e-ea625d84997e-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:34 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD Sep 11 21:36:34 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:34 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982fbe44-47db-4121-84c5-8da2c2f3ac37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee1de9cbce3492cb1daca01cd3e677a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:33Z,use_quota=True,user_id='d53f6b3624b04097a08f23aac5b10e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(426d15b3-add4-47d1-8fba-c570237d6afc),volume_type_id=426d15b3-add4-47d1-8fba-c570237d6afc)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Creating volume 982fbe44-47db-4121-84c5-8da2c2f3ac37 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:34 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:34 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 1073741824 Sep 11 21:36:34 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:35 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 1073741824" returned: 0 in 0.486s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:35 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 Sep 11 21:36:35 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:35 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37" returned: 0 in 0.266s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Attempting download of f12b3735-79dc-4345-8606-362965b0a4df ((None, [{'url': 'file:///opt/stack/data/glance/images/f12b3735-79dc-4345-8606-362965b0a4df', 'metadata': {}}])) to volume 982fbe44-47db-4121-84c5-8da2c2f3ac37. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae933c4-6f42-4f4a-9055-a7c9e37d16cc]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12b3735-79dc-4345-8606-362965b0a4df_l2ass5xe {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:35 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12b3735-79dc-4345-8606-362965b0a4df_l2ass5xe Sep 11 21:36:35 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:35 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12b3735-79dc-4345-8606-362965b0a4df_l2ass5xe" returned: 0 in 0.358s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12b3735-79dc-4345-8606-362965b0a4df_l2ass5xe {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:36 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12b3735-79dc-4345-8606-362965b0a4df_l2ass5xe Sep 11 21:36:36 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:36 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12b3735-79dc-4345-8606-362965b0a4df_l2ass5xe" returned: 1 in 0.332s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12b3735-79dc-4345-8606-362965b0a4df_l2ass5xe' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[36be352d-40e8-491b-835e-55d65b9cc68f]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:36 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD Sep 11 21:36:36 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:36 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:36 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD Sep 11 21:36:36 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:36 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] f12b3735-79dc-4345-8606-362965b0a4df was raw, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:36:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:36 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 Sep 11 21:36:36 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:37 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37" returned: 0 in 0.443s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f12b3735-79dc-4345-8606-362965b0a4df_oqlx30padevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:36:37 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:37 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 1G Sep 11 21:36:37 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:37 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 1G" returned: 0 in 0.341s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Downloaded image f12b3735-79dc-4345-8606-362965b0a4df ((None, [{'url': 'file:///opt/stack/data/glance/images/f12b3735-79dc-4345-8606-362965b0a4df', 'metadata': {}}])) to volume 982fbe44-47db-4121-84c5-8da2c2f3ac37 successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Temporary image f12b3735-79dc-4345-8606-362965b0a4df for user d53f6b3624b04097a08f23aac5b10e14 is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Marking volume 982fbe44-47db-4121-84c5-8da2c2f3ac37 as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Copying metadata from image f12b3735-79dc-4345-8606-362965b0a4df to 982fbe44-47db-4121-84c5-8da2c2f3ac37. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Creating volume glance metadata for volume 982fbe44-47db-4121-84c5-8da2c2f3ac37 backed by image f12b3735-79dc-4345-8606-362965b0a4df with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f12b3735-79dc-4345-8606-362965b0a4df', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd3e6efd7cf5925903ad8e7fb01aefe78', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66ddae7-2b4a-454a-8d86-b3d351792786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982fbe44-47db-4121-84c5-8da2c2f3ac37', 'volume_size': 1, 'image_id': 'f12b3735-79dc-4345-8606-362965b0a4df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12b3735-79dc-4345-8606-362965b0a4df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3e6efd7cf5925903ad8e7fb01aefe78', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bee1de9cbce3492cb1daca01cd3e677a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc18f2a685cbd517addd278649cc69dfe775a3dd47f2c238badaca7ab341b10c02f63eb0d4904e4ce8635a3a1512ea5a9b4b29842eeef8c3f0e2688e9df06014', 'id': 'f12b3735-79dc-4345-8606-362965b0a4df', 'created_at': datetime.datetime(2026, 9, 11, 19, 36, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12b3735-79dc-4345-8606-362965b0a4df/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e157b5f1-8b2a-44b5-9865-451f8bc68d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:37 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Volume volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 (982fbe44-47db-4121-84c5-8da2c2f3ac37): created successfully Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e157b5f1-8b2a-44b5-9865-451f8bc68d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Flow 'volume_create_manager' (b78fea2b-f781-43d4-bbc1-dfd7a0ab8dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:37 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-54f16a2d-5cba-4d64-b764-dd5d819502b2 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Created volume successfully. Sep 11 21:36:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Acquiring lock "cinder-982fbe44-47db-4121-84c5-8da2c2f3ac37-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "cinder-982fbe44-47db-4121-84c5-8da2c2f3ac37-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Acquiring lock "cinder-quobyte-982fbe44-47db-4121-84c5-8da2c2f3ac37" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "cinder-quobyte-982fbe44-47db-4121-84c5-8da2c2f3ac37" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f945e2ca-8f56-4a75-87d5-d18a32617c85]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:38 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 Sep 11 21:36:38 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:38 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:38 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37 Sep 11 21:36:38 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:38 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-982fbe44-47db-4121-84c5-8da2c2f3ac37" returned: 0 in 0.275s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "cinder-quobyte-982fbe44-47db-4121-84c5-8da2c2f3ac37" released by "delete_volume" :: held 0.703s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:38 devstack cinder-volume[87423]: WARNING cinder.quota [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:36:38 devstack cinder-volume[87423]: WARNING cinder.quota [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Created reservations ['19f1bafa-4e34-47d5-9e3c-41964e0e5846', '6df33402-abf9-4ce5-b03b-e8f09573340c', 'b4ff81b2-a848-44a6-bf59-2c92eccd910c', 'b53bac0b-75e6-455c-bda7-33890d804150'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:38 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:38 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:39 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:39 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Deleted volume successfully. Sep 11 21:36:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a1dd3856-884b-4020-aa37-f288d8b6a491 tempest-VolumeAndVolumeTypeFromImageTest-1951550561 None] Lock "cinder-982fbe44-47db-4121-84c5-8da2c2f3ac37-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Flow 'volume_create_manager' (41f01194-4605-4fd1-8b26-b2c17dca14a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e50b2f7-05bb-4f5f-a06c-f8f9a4692fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e50b2f7-05bb-4f5f-a06c-f8f9a4692fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1338257196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe6dc35-35ca-4575-aa6e-520bad7b79f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929b0bcb7c984ef7a9da808592a8d386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:43Z,use_quota=True,user_id='794c3c1697cd4b28be8e080b683852bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9667a5bc-740e-4fa9-879a-d85f67345846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9667a5bc-740e-4fa9-879a-d85f67345846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80000d5-444e-4d1f-ac9e-0be22f22ad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80000d5-444e-4d1f-ac9e-0be22f22ad9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe6dc35-35ca-4575-aa6e-520bad7b79f8', 'volume_name': 'volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1156e05-0656-4e67-92bb-6d8b2c462706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1156e05-0656-4e67-92bb-6d8b2c462706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276fe5ab-2e54-474a-b2a1-f95a141a4c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Volume ebe6dc35-35ca-4575-aa6e-520bad7b79f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8', 'volume_size': 1} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1338257196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe6dc35-35ca-4575-aa6e-520bad7b79f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929b0bcb7c984ef7a9da808592a8d386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:43Z,use_quota=True,user_id='794c3c1697cd4b28be8e080b683852bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Creating volume ebe6dc35-35ca-4575-aa6e-520bad7b79f8 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:43 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:43 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 1073741824 Sep 11 21:36:43 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (4fd830b6-179c-45a7-a1a0-b2bbb39accec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abd79c3-a95d-4a25-92a2-1627e73d0d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abd79c3-a95d-4a25-92a2-1627e73d0d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089453280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224ca510-b355-4b47-b6a1-29839acd15d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:44Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3263181e-522c-4aa4-9a98-ec5f23c33994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3263181e-522c-4aa4-9a98-ec5f23c33994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a921bd0-8b2b-4503-b58b-6405abc11aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a921bd0-8b2b-4503-b58b-6405abc11aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224ca510-b355-4b47-b6a1-29839acd15d0', 'volume_name': 'volume-224ca510-b355-4b47-b6a1-29839acd15d0', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c7499e-3267-4451-93e8-edad7f865cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c7499e-3267-4451-93e8-edad7f865cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9431c8-87d8-4dab-82fb-e498e1b0aa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:43 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume 224ca510-b355-4b47-b6a1-29839acd15d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224ca510-b355-4b47-b6a1-29839acd15d0', 'volume_size': 1} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:43 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 1073741824" returned: 0 in 0.453s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:43 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 Sep 11 21:36:43 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:44 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8" returned: 0 in 0.242s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089453280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224ca510-b355-4b47-b6a1-29839acd15d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:44Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Creating volume 224ca510-b355-4b47-b6a1-29839acd15d0 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:44 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276fe5ab-2e54-474a-b2a1-f95a141a4c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:44 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0 1073741824 Sep 11 21:36:44 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d228db-be20-4a87-b80a-560fa77c6f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:44 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Volume volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 (ebe6dc35-35ca-4575-aa6e-520bad7b79f8): created successfully Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d228db-be20-4a87-b80a-560fa77c6f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Flow 'volume_create_manager' (41f01194-4605-4fd1-8b26-b2c17dca14a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-df750548-7b1a-4ef4-9180-4844f3eb8695 tempest-VolumesTransfersV357Test-1734633958 None] Created volume successfully. Sep 11 21:36:44 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0 1073741824" returned: 0 in 0.447s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:44 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0 Sep 11 21:36:44 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:44 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0" returned: 0 in 0.253s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9431c8-87d8-4dab-82fb-e498e1b0aa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224ca510-b355-4b47-b6a1-29839acd15d0', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537f78fc-04b2-41a6-91e6-eb5a517e5e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:44 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume volume-224ca510-b355-4b47-b6a1-29839acd15d0 (224ca510-b355-4b47-b6a1-29839acd15d0): created successfully Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537f78fc-04b2-41a6-91e6-eb5a517e5e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (4fd830b6-179c-45a7-a1a0-b2bbb39accec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f9aa01d5-7c5e-4f7d-80f7-0258e5b6603e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created volume successfully. Sep 11 21:36:45 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-efb8d3b0-af12-43f7-9474-a2d17ed2286e tempest-VolumesTransfersV357Test-1370148464 None] Transfer volume completed successfully. Sep 11 21:36:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Acquiring lock "cinder-ebe6dc35-35ca-4575-aa6e-520bad7b79f8-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Lock "cinder-ebe6dc35-35ca-4575-aa6e-520bad7b79f8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Acquiring lock "cinder-quobyte-ebe6dc35-35ca-4575-aa6e-520bad7b79f8" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Lock "cinder-quobyte-ebe6dc35-35ca-4575-aa6e-520bad7b79f8" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:45 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c1a142-9e73-49ee-a922-4083381d4661]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:45 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 Sep 11 21:36:45 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:46 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8" returned: 0 in 0.366s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:46 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8 Sep 11 21:36:46 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:46 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ebe6dc35-35ca-4575-aa6e-520bad7b79f8" returned: 0 in 0.261s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Lock "cinder-quobyte-ebe6dc35-35ca-4575-aa6e-520bad7b79f8" released by "delete_volume" :: held 0.678s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (0ffb4598-8e5a-4fde-b44d-27c146ee4a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b480d532-3e7a-41b7-a27b-c9d9f8a88091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b480d532-3e7a-41b7-a27b-c9d9f8a88091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826298948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6fbeb3-5ec8-4919-b400-bd22ff89032f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:46Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7020061e-72f7-4eb4-b31b-513833dbaed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7020061e-72f7-4eb4-b31b-513833dbaed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af0f319-db71-4be4-9601-a12a09f787a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af0f319-db71-4be4-9601-a12a09f787a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6fbeb3-5ec8-4919-b400-bd22ff89032f', 'volume_name': 'volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de23d558-63e6-41bd-b91d-124427a2c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de23d558-63e6-41bd-b91d-124427a2c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439bd4bf-4ef4-4047-b969-96c7e1d093fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume 4a6fbeb3-5ec8-4919-b400-bd22ff89032f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f', 'volume_size': 1} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826298948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6fbeb3-5ec8-4919-b400-bd22ff89032f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:46Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Creating volume 4a6fbeb3-5ec8-4919-b400-bd22ff89032f {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:46 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:46 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f 1073741824 Sep 11 21:36:46 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Created reservations ['21adee28-19f6-4335-80dc-5f6707f132c4', '1a96abcb-fa92-4655-8a64-df1cb084dd3a', '8f85f7eb-f558-4200-8bf9-7870120021f7', '3e3a3796-b23e-46d0-af4f-b668162d9ba8'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:46 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:46 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (f3e285cd-2a15-4a04-9172-c73dc0f5f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139e55d1-932e-480b-af02-36f0a2833415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139e55d1-932e-480b-af02-36f0a2833415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1897962131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7037acd-d987-4085-b085-0a3334a0f445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:47Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f03e285-5256-436f-b8e8-3a1635b6ab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f03e285-5256-436f-b8e8-3a1635b6ab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4bf0cf-aea0-464b-ae35-0a7f9d7af93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4bf0cf-aea0-464b-ae35-0a7f9d7af93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7037acd-d987-4085-b085-0a3334a0f445', 'volume_name': 'volume-f7037acd-d987-4085-b085-0a3334a0f445', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2eb162-fc10-46bb-bb80-24a6fbbb3bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2eb162-fc10-46bb-bb80-24a6fbbb3bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ae6874-41cf-4e57-a5d9-98bfd76f06a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:46 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume f7037acd-d987-4085-b085-0a3334a0f445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7037acd-d987-4085-b085-0a3334a0f445', 'volume_size': 1} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:46 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.347s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:46 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Deleted volume successfully. Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-400768c7-5a21-4aa9-a987-c295323416dd tempest-VolumesTransfersV357Test-76496869 None] Lock "cinder-ebe6dc35-35ca-4575-aa6e-520bad7b79f8-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:47 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f 1073741824" returned: 0 in 0.627s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:47 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f Sep 11 21:36:47 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (873232fe-81d9-4e5f-99db-c12e844a5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec662c9a-b634-4ec3-b806-55a23a1462ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec662c9a-b634-4ec3-b806-55a23a1462ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479962779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275fafaf-b499-4fdd-bccf-929d3fbd2d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:47Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258b9dbf-42eb-4c08-b264-ba74f5a47492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258b9dbf-42eb-4c08-b264-ba74f5a47492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6009d22b-e2fc-4dc4-8a20-7e7bf397a0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6009d22b-e2fc-4dc4-8a20-7e7bf397a0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '275fafaf-b499-4fdd-bccf-929d3fbd2d38', 'volume_name': 'volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b898ba6-4720-4d8e-bb45-ba524b906206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b898ba6-4720-4d8e-bb45-ba524b906206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582427ba-ca58-4760-a58b-7830352b8b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume 275fafaf-b499-4fdd-bccf-929d3fbd2d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38', 'volume_size': 1} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:47 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f" returned: 0 in 0.395s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1897962131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7037acd-d987-4085-b085-0a3334a0f445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:47Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Creating volume f7037acd-d987-4085-b085-0a3334a0f445 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:47 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439bd4bf-4ef4-4047-b969-96c7e1d093fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445 1073741824 Sep 11 21:36:47 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cf596c-07c9-49c6-8551-3fb2634dda64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f (4a6fbeb3-5ec8-4919-b400-bd22ff89032f): created successfully Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cf596c-07c9-49c6-8551-3fb2634dda64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (0ffb4598-8e5a-4fde-b44d-27c146ee4a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:47 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-28c6af91-efcd-47f2-84de-84761e71fd6a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created volume successfully. Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Flow 'volume_create_manager' (575bc0fe-5d96-45d9-88dd-4a99fe7a604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd633ad-20f3-420a-98a7-dd207c678407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd633ad-20f3-420a-98a7-dd207c678407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1676681836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f777c941-115f-4b27-ac56-f7cb47bb3630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929b0bcb7c984ef7a9da808592a8d386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:47Z,use_quota=True,user_id='794c3c1697cd4b28be8e080b683852bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67e8110-8f19-4132-9efc-eb8ba764a6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67e8110-8f19-4132-9efc-eb8ba764a6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995e68c7-0966-4cd5-aef8-5060afd9b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995e68c7-0966-4cd5-aef8-5060afd9b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f777c941-115f-4b27-ac56-f7cb47bb3630', 'volume_name': 'volume-f777c941-115f-4b27-ac56-f7cb47bb3630', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a1b2a3-ad23-477d-abe5-04698ec9b726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a1b2a3-ad23-477d-abe5-04698ec9b726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c47616-e550-47e6-9571-f5afc01eb860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Volume f777c941-115f-4b27-ac56-f7cb47bb3630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f777c941-115f-4b27-ac56-f7cb47bb3630', 'volume_size': 1} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (8d985820-06df-4d6a-9561-09d32bd82319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206144df-6d79-400e-b373-aea86ab335ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206144df-6d79-400e-b373-aea86ab335ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402018018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52aa08aa-e0d3-4047-a3f5-9724f471b263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:48Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2f3e27-0afc-41f3-8359-89134846be00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:47 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2f3e27-0afc-41f3-8359-89134846be00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4b9e6e-4f25-46fc-8c51-f7a1e11ea3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4b9e6e-4f25-46fc-8c51-f7a1e11ea3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52aa08aa-e0d3-4047-a3f5-9724f471b263', 'volume_name': 'volume-52aa08aa-e0d3-4047-a3f5-9724f471b263', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0a2dd7-f393-45b8-8e62-018164a45a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0a2dd7-f393-45b8-8e62-018164a45a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a59ad6-46f4-4d38-acde-b0e6660758b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:48 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume 52aa08aa-e0d3-4047-a3f5-9724f471b263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52aa08aa-e0d3-4047-a3f5-9724f471b263', 'volume_size': 1} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:48 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445 1073741824" returned: 0 in 0.574s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (4fa8ce50-2d33-4019-8909-64d4b7d0a355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba75da2-9b98-4513-9109-dc92733fb4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba75da2-9b98-4513-9109-dc92733fb4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-563942797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6c9be8-ccdc-4b4e-ad6a-97699bc92969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:48Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73662225-6121-4d05-b3f5-48e1f928f0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73662225-6121-4d05-b3f5-48e1f928f0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6113b53c-f7a7-4acf-9f94-876a61dc648c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6113b53c-f7a7-4acf-9f94-876a61dc648c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6c9be8-ccdc-4b4e-ad6a-97699bc92969', 'volume_name': 'volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4222bb82-6e0a-4026-bc02-55ab32da0a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4222bb82-6e0a-4026-bc02-55ab32da0a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e61ccf-d678-410d-9faa-3cd5a898a388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:48 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume db6c9be8-ccdc-4b4e-ad6a-97699bc92969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969', 'volume_size': 1} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:48 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445 Sep 11 21:36:48 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:48 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445" returned: 0 in 0.259s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479962779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275fafaf-b499-4fdd-bccf-929d3fbd2d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:47Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Creating volume 275fafaf-b499-4fdd-bccf-929d3fbd2d38 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:48 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ae6874-41cf-4e57-a5d9-98bfd76f06a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7037acd-d987-4085-b085-0a3334a0f445', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1883b2cf-7ec9-4328-b1c8-74707a09d73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:48 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 1073741824 Sep 11 21:36:48 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:48 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume volume-f7037acd-d987-4085-b085-0a3334a0f445 (f7037acd-d987-4085-b085-0a3334a0f445): created successfully Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1883b2cf-7ec9-4328-b1c8-74707a09d73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (f3e285cd-2a15-4a04-9172-c73dc0f5f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:48 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-30f8ddf4-c580-4cd3-913b-7d696f8efb02 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created volume successfully. Sep 11 21:36:48 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 1073741824" returned: 0 in 0.429s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:48 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 Sep 11 21:36:48 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:49 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38" returned: 0 in 0.260s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1676681836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f777c941-115f-4b27-ac56-f7cb47bb3630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929b0bcb7c984ef7a9da808592a8d386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:47Z,use_quota=True,user_id='794c3c1697cd4b28be8e080b683852bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Creating volume f777c941-115f-4b27-ac56-f7cb47bb3630 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:49 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582427ba-ca58-4760-a58b-7830352b8b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:49 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630 1073741824 Sep 11 21:36:49 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b041f29-984e-466b-ba1f-f7ec1fea220c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:49 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 (275fafaf-b499-4fdd-bccf-929d3fbd2d38): created successfully Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b041f29-984e-466b-ba1f-f7ec1fea220c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (873232fe-81d9-4e5f-99db-c12e844a5982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f39d74b0-1c1d-4d17-96f0-f8b35516ce54 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created volume successfully. Sep 11 21:36:49 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630 1073741824" returned: 0 in 0.440s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:49 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630 Sep 11 21:36:49 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:49 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630" returned: 0 in 0.248s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.894s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402018018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52aa08aa-e0d3-4047-a3f5-9724f471b263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:48Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Creating volume 52aa08aa-e0d3-4047-a3f5-9724f471b263 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:49 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c47616-e550-47e6-9571-f5afc01eb860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f777c941-115f-4b27-ac56-f7cb47bb3630', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:49 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 1073741824 Sep 11 21:36:49 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a214d13-0138-4774-861e-706a76aa5af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:49 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Volume volume-f777c941-115f-4b27-ac56-f7cb47bb3630 (f777c941-115f-4b27-ac56-f7cb47bb3630): created successfully Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a214d13-0138-4774-861e-706a76aa5af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Flow 'volume_create_manager' (575bc0fe-5d96-45d9-88dd-4a99fe7a604e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-7b9e46a2-abc4-49e1-a3a5-00e90833f689 tempest-VolumesTransfersV357Test-1734633958 None] Created volume successfully. Sep 11 21:36:50 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 1073741824" returned: 0 in 0.438s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:50 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 Sep 11 21:36:50 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:50 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263" returned: 0 in 0.272s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.497s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-563942797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6c9be8-ccdc-4b4e-ad6a-97699bc92969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa029ccfa3da429bb2f4d07953765a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:36:48Z,use_quota=True,user_id='3a01051de5834cdeb73f63415e410e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Creating volume db6c9be8-ccdc-4b4e-ad6a-97699bc92969 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:36:50 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:50 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 1073741824 Sep 11 21:36:50 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a59ad6-46f4-4d38-acde-b0e6660758b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52aa08aa-e0d3-4047-a3f5-9724f471b263', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ab5a78-411a-43c0-bc08-836289939287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 (52aa08aa-e0d3-4047-a3f5-9724f471b263): created successfully Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ab5a78-411a-43c0-bc08-836289939287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (8d985820-06df-4d6a-9561-09d32bd82319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cbe60481-fc21-4766-9e1b-7c72ba1996e6 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created volume successfully. Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Acquiring lock "cinder-f777c941-115f-4b27-ac56-f7cb47bb3630-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Lock "cinder-f777c941-115f-4b27-ac56-f7cb47bb3630-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Acquiring lock "cinder-quobyte-f777c941-115f-4b27-ac56-f7cb47bb3630" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Lock "cinder-quobyte-f777c941-115f-4b27-ac56-f7cb47bb3630" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8408ecc8-c742-49bc-8661-a77a82a3c9d1]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:51 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630 Sep 11 21:36:51 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:51 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 1073741824" returned: 0 in 0.470s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:51 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 Sep 11 21:36:51 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:51 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630" returned: 0 in 0.404s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:51 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630 Sep 11 21:36:51 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:51 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969" returned: 0 in 0.275s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e61ccf-d678-410d-9faa-3cd5a898a388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bcc34a-8c01-4c97-8506-3a413f65326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:36:51 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Volume volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 (db6c9be8-ccdc-4b4e-ad6a-97699bc92969): created successfully Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bcc34a-8c01-4c97-8506-3a413f65326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Flow 'volume_create_manager' (4fa8ce50-2d33-4019-8909-64d4b7d0a355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:36:51 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-993644c9-1c73-450e-bdf2-73bdac580fef tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created volume successfully. Sep 11 21:36:51 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f777c941-115f-4b27-ac56-f7cb47bb3630" returned: 0 in 0.257s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Lock "cinder-quobyte-f777c941-115f-4b27-ac56-f7cb47bb3630" released by "delete_volume" :: held 0.698s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Created reservations ['6d259eed-a09a-461d-994a-70867be6b439', '0de5288d-4e7f-4bdb-96a5-2a495ad59495', '739452b1-bbc7-470d-a235-7f5f1d85c3c7', 'e545dfc5-a6a4-4d75-87d1-cf28a43ee7fc'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:51 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:51 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:52 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.263s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:52 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:52 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Deleted volume successfully. Sep 11 21:36:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cc7079a0-2d3b-4c73-a94e-b7218942c88b tempest-VolumesTransfersV357Test-76496869 None] Lock "cinder-f777c941-115f-4b27-ac56-f7cb47bb3630-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-db6c9be8-ccdc-4b4e-ad6a-97699bc92969-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-db6c9be8-ccdc-4b4e-ad6a-97699bc92969-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-quobyte-db6c9be8-ccdc-4b4e-ad6a-97699bc92969" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-db6c9be8-ccdc-4b4e-ad6a-97699bc92969" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:52 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf51307-52da-4dbb-8277-cbbff39cb6f3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:52 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 Sep 11 21:36:52 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:53 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969" returned: 0 in 0.431s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:53 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969 Sep 11 21:36:53 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:53 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-db6c9be8-ccdc-4b4e-ad6a-97699bc92969" returned: 0 in 0.276s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-db6c9be8-ccdc-4b4e-ad6a-97699bc92969" released by "delete_volume" :: held 0.757s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created reservations ['389bb6f2-6ab7-4a96-bc05-bc9e0cce675d', '5839b18d-b25c-46b2-9602-b1576d8130d1', '97dffe26-9221-44cf-bd2a-182a44f9ff56', '480b3eed-0267-4cc8-9326-5d5af8472396'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:53 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:53 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-52aa08aa-e0d3-4047-a3f5-9724f471b263-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-52aa08aa-e0d3-4047-a3f5-9724f471b263-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:53 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.308s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:53 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Deleted volume successfully. Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-05c87871-8f9b-477b-9cf4-61b1ef57a360 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-db6c9be8-ccdc-4b4e-ad6a-97699bc92969-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-quobyte-52aa08aa-e0d3-4047-a3f5-9724f471b263" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-52aa08aa-e0d3-4047-a3f5-9724f471b263" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09bddc5-70ac-40f2-b592-eb8622d2d8d8]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:54 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 Sep 11 21:36:54 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:54 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263" returned: 0 in 0.413s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:54 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263 Sep 11 21:36:54 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:54 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-52aa08aa-e0d3-4047-a3f5-9724f471b263" returned: 0 in 0.268s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-52aa08aa-e0d3-4047-a3f5-9724f471b263" released by "delete_volume" :: held 0.729s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created reservations ['55cc6b16-acfa-49f4-a7f0-aaae08935fe3', '3ced8056-0dc9-4e1c-8c34-5c2b551488fa', '26d0ed5a-b191-4fc4-a912-093b61605687', '4a138fb5-f428-4330-8fcc-f0f00b8b6a7f'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:54 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:54 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-275fafaf-b499-4fdd-bccf-929d3fbd2d38-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-275fafaf-b499-4fdd-bccf-929d3fbd2d38-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-quobyte-275fafaf-b499-4fdd-bccf-929d3fbd2d38" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:55 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.279s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-275fafaf-b499-4fdd-bccf-929d3fbd2d38" acquired by "delete_volume" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:55 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Deleted volume successfully. Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba25cda6-aab0-4d8f-b092-95f7ba3d2fda]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db5f17da-4ca6-4c87-bb7b-16a203ae873a tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-52aa08aa-e0d3-4047-a3f5-9724f471b263-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:55 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 Sep 11 21:36:55 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:55 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38" returned: 0 in 0.406s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:55 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38 Sep 11 21:36:55 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:55 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-275fafaf-b499-4fdd-bccf-929d3fbd2d38" returned: 0 in 0.272s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-275fafaf-b499-4fdd-bccf-929d3fbd2d38" released by "delete_volume" :: held 0.740s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created reservations ['bb8d8b4d-a115-4ac0-a8d0-e733d3183505', '73f80ec3-b30d-48e6-a06d-55e6b8f63530', 'd20ac255-f3ee-4cb1-bb40-1de9bf240233', '1f0ddfab-290e-432c-b2a2-b16c15f1297a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:55 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:55 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-f7037acd-d987-4085-b085-0a3334a0f445-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-f7037acd-d987-4085-b085-0a3334a0f445-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:56 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-quobyte-f7037acd-d987-4085-b085-0a3334a0f445" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Deleted volume successfully. Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-f7037acd-d987-4085-b085-0a3334a0f445" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c58a0245-29b7-49e0-990a-dd3d3e079410 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-275fafaf-b499-4fdd-bccf-929d3fbd2d38-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166add8-0f99-4f5c-bece-c9dea2d4a374]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:56 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445 Sep 11 21:36:56 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:56 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445" returned: 0 in 0.413s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:56 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445 Sep 11 21:36:56 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:56 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f7037acd-d987-4085-b085-0a3334a0f445" returned: 0 in 0.257s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-f7037acd-d987-4085-b085-0a3334a0f445" released by "delete_volume" :: held 0.728s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created reservations ['f8f26e87-78f2-4ce8-8cba-9e2902165c57', '1365ea64-9d5c-41b0-a679-d2da9f944361', 'f5e37697-c053-4e3e-9a68-e3916571af03', '7f7c93be-3abe-49d1-a794-abeda6b99910'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:57 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:57 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-4a6fbeb3-5ec8-4919-b400-bd22ff89032f-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-4a6fbeb3-5ec8-4919-b400-bd22ff89032f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-quobyte-4a6fbeb3-5ec8-4919-b400-bd22ff89032f" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:57 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Deleted volume successfully. Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-4a6fbeb3-5ec8-4919-b400-bd22ff89032f" acquired by "delete_volume" :: waited 0.036s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cdcaad2b-98f4-46fe-9e32-c66135051d8e tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-f7037acd-d987-4085-b085-0a3334a0f445-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[254f6675-5d64-4757-b1af-cc97f1beaf61]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:57 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f Sep 11 21:36:57 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:57 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f" returned: 0 in 0.405s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:57 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f Sep 11 21:36:57 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:58 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-4a6fbeb3-5ec8-4919-b400-bd22ff89032f" returned: 0 in 0.283s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-4a6fbeb3-5ec8-4919-b400-bd22ff89032f" released by "delete_volume" :: held 0.731s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created reservations ['06ebb32e-72ad-4440-a1b5-3a8ef0a9d434', 'c61ab4ce-60c4-475b-bbfe-837e8adb2c1b', '8ec3d3ff-42d5-4690-a623-cf27705ebe02', '4bf9897f-6f36-42dd-a5ee-0bbf8490095f'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:58 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:58 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-224ca510-b355-4b47-b6a1-29839acd15d0-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-224ca510-b355-4b47-b6a1-29839acd15d0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:58 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.304s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Deleted volume successfully. Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "cinder-quobyte-224ca510-b355-4b47-b6a1-29839acd15d0" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-224ca510-b355-4b47-b6a1-29839acd15d0" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-cfad47c0-5e6c-4e1e-83d4-3d78a03f6714 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-4a6fbeb3-5ec8-4919-b400-bd22ff89032f-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87f6d88-227b-4d81-9a4a-00305f041e16]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:36:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:58 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0 Sep 11 21:36:58 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:59 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0" returned: 0 in 0.416s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:59 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0 Sep 11 21:36:59 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:59 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-224ca510-b355-4b47-b6a1-29839acd15d0" returned: 0 in 0.261s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-quobyte-224ca510-b355-4b47-b6a1-29839acd15d0" released by "delete_volume" :: held 0.730s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Created reservations ['dbe96760-12fc-4929-97ac-d40c7df9d6cd', 'de253859-bd25-40c1-a602-93aed9fe2696', 'eafa9bd9-bb00-4ac3-a0d2-c22cddc31d7b', '8ca79332-8d34-4653-ba96-d3eaf0c264aa'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:36:59 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:36:59 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:36:59 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.270s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:36:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Deleted volume successfully. Sep 11 21:36:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4c604121-5c7c-4b6c-84e2-315b0aa10780 tempest-CreateVolumesFromSourceVolumeTest-899425764 None] Lock "cinder-224ca510-b355-4b47-b6a1-29839acd15d0-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Flow 'volume_create_manager' (10b3cb63-90f2-4299-aae1-95fdd5ac27db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ebba99-e48b-4c3f-81e7-88b897f35a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ebba99-e48b-4c3f-81e7-88b897f35a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fd9ed2-6da6-40ac-8ac4-2aa142739659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c0ce194e144981ae535d1cf8225162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:37:06Z,use_quota=True,user_id='ac5f0036eff143b88f5f6ed8c1646d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d48618-767d-4bb1-93e0-edb97f165f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d48618-767d-4bb1-93e0-edb97f165f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b1b9fe-27de-4d86-b48c-f55ce996960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b1b9fe-27de-4d86-b48c-f55ce996960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06fd9ed2-6da6-40ac-8ac4-2aa142739659', 'volume_name': 'volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659', 'volume_size': 1, 'image_id': 'e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b36bd1ce050b1ef3988628047b5cb56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c0ce194e144981ae535d1cf8225162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '61c450021c10523bc12148b5732bb24bdfcbf52febd1e1418509d5acb27268ee4a4b1afa4f995c588a3bdbfcd269eaffea58f8f68a3bbb18642d677baa7ef10a', 'id': 'e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'created_at': datetime.datetime(2026, 9, 11, 19, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 37, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e37a6c55-e705-4d0c-861d-3a26a8b6d62a/file', 'properties': {}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7abfa5a-5413-4cc0-9483-5d7791e9c659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7abfa5a-5413-4cc0-9483-5d7791e9c659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91aa5b9-2e18-4fea-a6ba-433df7a278cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:05 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Volume 06fd9ed2-6da6-40ac-8ac4-2aa142739659: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659', 'volume_size': 1, 'image_id': 'e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b36bd1ce050b1ef3988628047b5cb56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c0ce194e144981ae535d1cf8225162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '61c450021c10523bc12148b5732bb24bdfcbf52febd1e1418509d5acb27268ee4a4b1afa4f995c588a3bdbfcd269eaffea58f8f68a3bbb18642d677baa7ef10a', 'id': 'e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'created_at': datetime.datetime(2026, 9, 11, 19, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 37, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e37a6c55-e705-4d0c-861d-3a26a8b6d62a/file', 'properties': {}}, 'image_service': } Sep 11 21:37:05 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Trying to clone 06fd9ed2-6da6-40ac-8ac4-2aa142739659 from image e37a6c55-e705-4d0c-861d-3a26a8b6d62a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:37:06 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Image download 0.00 MB at 0.00 MB/s Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[18344e0a-eb07-4de6-83d0-4faca57b1b20]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:06 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD Sep 11 21:37:06 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:06 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:06 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD Sep 11 21:37:06 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:06 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Temporary image e37a6c55-e705-4d0c-861d-3a26a8b6d62a is fetched for user ac5f0036eff143b88f5f6ed8c1646d27. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbfd057-a1be-4722-ae09-f37113949e43]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:07 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD Sep 11 21:37:07 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:07 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:07 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD Sep 11 21:37:07 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:07 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fd9ed2-6da6-40ac-8ac4-2aa142739659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c0ce194e144981ae535d1cf8225162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:37:06Z,use_quota=True,user_id='ac5f0036eff143b88f5f6ed8c1646d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Creating volume 06fd9ed2-6da6-40ac-8ac4-2aa142739659 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:37:07 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:37:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:07 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 1073741824 Sep 11 21:37:07 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:08 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 1073741824" returned: 0 in 0.469s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:08 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 Sep 11 21:37:08 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Flow 'volume_create_manager' (8ef0be8c-52cb-44fe-a630-4833b06a34bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467ae2bc-9e26-45fe-83ce-0e10328903ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467ae2bc-9e26-45fe-83ce-0e10328903ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1107951924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54b59f-d3b0-4d7e-afa6-1de7f04df906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71064c2883204a0bb19962ebdef5b345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:37:08Z,use_quota=True,user_id='c510159250d743bfbdd3cdb694024f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ac7b77-3cf6-407d-b6fa-aa0353b9dc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ac7b77-3cf6-407d-b6fa-aa0353b9dc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bd6371-8207-4c34-947f-60fb29db46f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bd6371-8207-4c34-947f-60fb29db46f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd54b59f-d3b0-4d7e-afa6-1de7f04df906', 'volume_name': 'volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7d09d2-c920-4c19-96a5-8887dbadad62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7d09d2-c920-4c19-96a5-8887dbadad62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c6c731-be03-44da-96dc-f5ee6b815a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:08 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Volume cd54b59f-d3b0-4d7e-afa6-1de7f04df906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906', 'volume_size': 1} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:08 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659" returned: 0 in 0.243s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1107951924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54b59f-d3b0-4d7e-afa6-1de7f04df906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71064c2883204a0bb19962ebdef5b345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:37:08Z,use_quota=True,user_id='c510159250d743bfbdd3cdb694024f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Creating volume cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:37:08 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:08 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 1073741824 Sep 11 21:37:08 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Attempting download of e37a6c55-e705-4d0c-861d-3a26a8b6d62a ((None, [{'url': 'file:///opt/stack/data/glance/images/e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'metadata': {}}])) to volume 06fd9ed2-6da6-40ac-8ac4-2aa142739659. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f0bd52-63b2-494d-bacb-9367a5179a00]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_zg7ty33d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:08 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_zg7ty33d Sep 11 21:37:08 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:08 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 1073741824" returned: 0 in 0.432s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:08 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_zg7ty33d" returned: 0 in 0.353s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_zg7ty33d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:08 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 Sep 11 21:37:08 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:08 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_zg7ty33d Sep 11 21:37:08 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:09 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" returned: 0 in 0.270s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c6c731-be03-44da-96dc-f5ee6b815a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f1ec6f-8f3b-49db-a166-f7580905aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:09 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Volume volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 (cd54b59f-d3b0-4d7e-afa6-1de7f04df906): created successfully Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f1ec6f-8f3b-49db-a166-f7580905aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Flow 'volume_create_manager' (8ef0be8c-52cb-44fe-a630-4833b06a34bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:37:09 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_zg7ty33d" returned: 1 in 0.357s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_zg7ty33d' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5075f8-6340-41fe-a218-6af162b4a361]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9f31d51f-6757-4ea2-b91d-eb49cba63216 tempest-VolumesActionsTest-1680247242 None] Created volume successfully. Sep 11 21:37:09 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD Sep 11 21:37:09 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:09 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:09 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD Sep 11 21:37:09 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:09 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] e37a6c55-e705-4d0c-861d-3a26a8b6d62a was raw, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:37:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:09 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 Sep 11 21:37:09 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:10 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659" returned: 0 in 0.490s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e37a6c55-e705-4d0c-861d-3a26a8b6d62a_8bydtdcbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:37:10 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:10 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 1G Sep 11 21:37:10 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:10 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 1G" returned: 0 in 0.330s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Downloaded image e37a6c55-e705-4d0c-861d-3a26a8b6d62a ((None, [{'url': 'file:///opt/stack/data/glance/images/e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'metadata': {}}])) to volume 06fd9ed2-6da6-40ac-8ac4-2aa142739659 successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Temporary image e37a6c55-e705-4d0c-861d-3a26a8b6d62a for user ac5f0036eff143b88f5f6ed8c1646d27 is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Marking volume 06fd9ed2-6da6-40ac-8ac4-2aa142739659 as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Copying metadata from image e37a6c55-e705-4d0c-861d-3a26a8b6d62a to 06fd9ed2-6da6-40ac-8ac4-2aa142739659. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Creating volume glance metadata for volume 06fd9ed2-6da6-40ac-8ac4-2aa142739659 backed by image e37a6c55-e705-4d0c-861d-3a26a8b6d62a with: {'image_id': 'e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4b36bd1ce050b1ef3988628047b5cb56', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91aa5b9-2e18-4fea-a6ba-433df7a278cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659', 'volume_size': 1, 'image_id': 'e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b36bd1ce050b1ef3988628047b5cb56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c0ce194e144981ae535d1cf8225162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '61c450021c10523bc12148b5732bb24bdfcbf52febd1e1418509d5acb27268ee4a4b1afa4f995c588a3bdbfcd269eaffea58f8f68a3bbb18642d677baa7ef10a', 'id': 'e37a6c55-e705-4d0c-861d-3a26a8b6d62a', 'created_at': datetime.datetime(2026, 9, 11, 19, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 37, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e37a6c55-e705-4d0c-861d-3a26a8b6d62a/file', 'properties': {}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cedb913-5464-48ef-8785-150a7bff3a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:10 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Volume volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 (06fd9ed2-6da6-40ac-8ac4-2aa142739659): created successfully Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cedb913-5464-48ef-8785-150a7bff3a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Flow 'volume_create_manager' (10b3cb63-90f2-4299-aae1-95fdd5ac27db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:37:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-28b7f44b-4a55-400c-844c-e50180209f5b tempest-VolumeImageDependencyTests-1235883511 None] Created volume successfully. Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Acquiring lock "cinder-06fd9ed2-6da6-40ac-8ac4-2aa142739659-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Lock "cinder-06fd9ed2-6da6-40ac-8ac4-2aa142739659-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Acquiring lock "cinder-quobyte-06fd9ed2-6da6-40ac-8ac4-2aa142739659" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Lock "cinder-quobyte-06fd9ed2-6da6-40ac-8ac4-2aa142739659" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e66604e-29b0-42f1-9664-a78a1d930442]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:12 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 Sep 11 21:37:12 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:12 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659" returned: 0 in 0.428s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:12 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659 Sep 11 21:37:12 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:12 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06fd9ed2-6da6-40ac-8ac4-2aa142739659" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Lock "cinder-quobyte-06fd9ed2-6da6-40ac-8ac4-2aa142739659" released by "delete_volume" :: held 0.768s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:12 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Created reservations ['e00eca02-e256-4567-a151-1d26a6a654cf', '7e666652-7b27-4a68-8bdf-1c6bbbf32264', 'ec2dd126-799e-4f98-a01a-f482f64175c3', 'e762b068-720c-4d24-b01e-6e03fbda4f08'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:37:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:37:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:37:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:13 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:37:13 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:13 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.279s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:13 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:37:13 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Deleted volume successfully. Sep 11 21:37:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dec8e88e-6065-407f-90a3-d4aff804479e tempest-VolumeImageDependencyTests-1235883511 None] Lock "cinder-06fd9ed2-6da6-40ac-8ac4-2aa142739659-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:37:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:37:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:37:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:15 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:37:15 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:16 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.369s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:37:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:37:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:37:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:37:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9b602f64-1428-4cae-8603-6fcf8ff40e99 tempest-VolumesActionsTest-1680247242 None] Acquiring lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" by "attach_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9b602f64-1428-4cae-8603-6fcf8ff40e99 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" acquired by "attach_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9b602f64-1428-4cae-8603-6fcf8ff40e99 tempest-VolumesActionsTest-1680247242 None] Attaching volume cd54b59f-d3b0-4d7e-afa6-1de7f04df906 to instance 2b98e057-4896-4754-8e13-41f373da7a5f at mountpoint /dev/vdb on host None. Sep 11 21:37:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9b602f64-1428-4cae-8603-6fcf8ff40e99 tempest-VolumesActionsTest-1680247242 None] Attach volume completed successfully. Sep 11 21:37:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-9b602f64-1428-4cae-8603-6fcf8ff40e99 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" released by "attach_volume" :: held 0.106s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed556271-cfb5-4a4c-b5e4-bdd16dce1a68 tempest-VolumesActionsTest-1680247242 None] Acquiring lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906-detach_volume" by "detach_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed556271-cfb5-4a4c-b5e4-bdd16dce1a68 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:18 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ed556271-cfb5-4a4c-b5e4-bdd16dce1a68 tempest-VolumesActionsTest-1680247242 None] Detaching volume cd54b59f-d3b0-4d7e-afa6-1de7f04df906 from instance 2b98e057-4896-4754-8e13-41f373da7a5f. Sep 11 21:37:18 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ed556271-cfb5-4a4c-b5e4-bdd16dce1a68 tempest-VolumesActionsTest-1680247242 None] Detach volume completed successfully. Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed556271-cfb5-4a4c-b5e4-bdd16dce1a68 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Flow 'volume_create_manager' (602d3208-b133-49e6-bbb4-8b3109b0bc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4be4868-7ee6-4061-af23-458bca56a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4be4868-7ee6-4061-af23-458bca56a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516817072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a908c6-9a9f-4ac8-97b6-c22123459a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d30216741354690b4f65997853e48f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:37:18Z,use_quota=True,user_id='e3e2dc8a557745f58c481e5a78873880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b654d88f-ec32-49b6-b610-cbf76ea29d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b654d88f-ec32-49b6-b610-cbf76ea29d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27162457-b5f3-43a6-b8ca-9556ff744681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27162457-b5f3-43a6-b8ca-9556ff744681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a908c6-9a9f-4ac8-97b6-c22123459a10', 'volume_name': 'volume-31a908c6-9a9f-4ac8-97b6-c22123459a10', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c638ef-18a6-4cd3-b903-043dded19fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c638ef-18a6-4cd3-b903-043dded19fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd6d60c-a279-4ebe-9ea4-764e6d09227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:18 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Volume 31a908c6-9a9f-4ac8-97b6-c22123459a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a908c6-9a9f-4ac8-97b6-c22123459a10', 'volume_size': 1} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516817072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a908c6-9a9f-4ac8-97b6-c22123459a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d30216741354690b4f65997853e48f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:37:18Z,use_quota=True,user_id='e3e2dc8a557745f58c481e5a78873880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Creating volume 31a908c6-9a9f-4ac8-97b6-c22123459a10 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:37:18 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:37:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:18 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 1073741824 Sep 11 21:37:18 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:18 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 1073741824" returned: 0 in 0.611s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:19 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 Sep 11 21:37:19 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:19 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10" returned: 0 in 0.280s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:37:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:19 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd6d60c-a279-4ebe-9ea4-764e6d09227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a908c6-9a9f-4ac8-97b6-c22123459a10', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:19 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6818f4c-7328-4ee9-a4da-bfee119abd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:19 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Volume volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 (31a908c6-9a9f-4ac8-97b6-c22123459a10): created successfully Sep 11 21:37:19 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6818f4c-7328-4ee9-a4da-bfee119abd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:19 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Flow 'volume_create_manager' (602d3208-b133-49e6-bbb4-8b3109b0bc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:37:19 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-39660e04-72a7-4282-933a-d36395cfcbf4 tempest-ProjectReaderTests-411099432 None] Created volume successfully. Sep 11 21:37:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Acquiring lock "cinder-31a908c6-9a9f-4ac8-97b6-c22123459a10-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Lock "cinder-31a908c6-9a9f-4ac8-97b6-c22123459a10-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Acquiring lock "cinder-quobyte-31a908c6-9a9f-4ac8-97b6-c22123459a10" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Lock "cinder-quobyte-31a908c6-9a9f-4ac8-97b6-c22123459a10" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da0aed0-8491-440e-a5a8-5d8771bbf926]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:20 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 Sep 11 21:37:20 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:21 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10" returned: 0 in 0.398s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:21 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10 Sep 11 21:37:21 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:21 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-31a908c6-9a9f-4ac8-97b6-c22123459a10" returned: 0 in 0.258s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Lock "cinder-quobyte-31a908c6-9a9f-4ac8-97b6-c22123459a10" released by "delete_volume" :: held 0.705s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Created reservations ['b0ca311a-64c7-41cb-be66-55304dd71d43', 'bc074407-dcbd-465a-8715-7b2ebf7da456', '6065de8b-adfe-4c4d-adb8-e661085380bd', '688c042b-7d2a-49b7-a653-51d6d4b5f6a7'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:21 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:37:21 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:21 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:37:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Deleted volume successfully. Sep 11 21:37:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfa0166a-7b73-4057-b619-f21136d6c5ba tempest-ProjectReaderTests-411099432 None] Lock "cinder-31a908c6-9a9f-4ac8-97b6-c22123459a10-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=105,cinder:UPDATE=149,cinder:INSERT=44,cinder:DELETE=15 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Flow 'volume_create_manager' (539b20b6-6db5-4fc4-b348-76eebe78b3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a8a4ed-ef5a-4554-8072-c14c17d89c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a8a4ed-ef5a-4554-8072-c14c17d89c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1126010432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d30216741354690b4f65997853e48f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:37:22Z,use_quota=True,user_id='e3e2dc8a557745f58c481e5a78873880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29940d7b-32a3-45a4-8dd2-94c778189ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29940d7b-32a3-45a4-8dd2-94c778189ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a407f30-6db5-43b8-8ca7-8a331f906427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a407f30-6db5-43b8-8ca7-8a331f906427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1', 'volume_name': 'volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d448c46d-c80c-4c6f-bf24-60457208699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d448c46d-c80c-4c6f-bf24-60457208699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6d6b75-088a-4ab2-a3bc-c538ff14e49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:22 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Volume 6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1', 'volume_size': 1} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1126010432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d30216741354690b4f65997853e48f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:37:22Z,use_quota=True,user_id='e3e2dc8a557745f58c481e5a78873880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Creating volume 6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:37:22 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:22 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 1073741824 Sep 11 21:37:22 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:22 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 1073741824" returned: 0 in 0.516s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:22 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 Sep 11 21:37:22 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:23 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:37:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6d6b75-088a-4ab2-a3bc-c538ff14e49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ef6a0e-e500-482b-a217-a28d79aa65dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:37:23 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Volume volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 (6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1): created successfully Sep 11 21:37:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ef6a0e-e500-482b-a217-a28d79aa65dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:37:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Flow 'volume_create_manager' (539b20b6-6db5-4fc4-b348-76eebe78b3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:37:23 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a74af401-add4-4fa9-bfe5-6ea11f923677 tempest-ProjectReaderTests-411099432 None] Created volume successfully. Sep 11 21:37:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Acquiring lock "cinder-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Lock "cinder-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Acquiring lock "cinder-quobyte-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Lock "cinder-quobyte-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:24 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf1b93c-aa06-4a43-b646-7f49a465b7c2]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:24 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 Sep 11 21:37:24 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:24 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1" returned: 0 in 0.428s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:24 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1 Sep 11 21:37:25 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:25 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1" returned: 0 in 0.300s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Lock "cinder-quobyte-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1" released by "delete_volume" :: held 0.778s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Created reservations ['203b9c9e-b404-4ff6-8401-b3b435c3178c', 'd46a2a9d-9a7f-4bb0-8781-58ce474049b6', '502b3d01-d9a0-4903-aa45-edc92b0abefd', '991d61a3-f1f3-4b61-9dfe-6741f11caf27'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:25 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:37:25 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.353s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:37:25 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Deleted volume successfully. Sep 11 21:37:25 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02a32ea5-015b-435b-b0c9-0705b7d4cf2d tempest-ProjectReaderTests-411099432 None] Lock "cinder-6806defc-2eeb-4f3c-b4e3-9d0e02a37ef1-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c586058c-400b-4378-aeab-fd14a689a026 tempest-VolumesActionsTest-1680247242 None] Acquiring lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" by "attach_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c586058c-400b-4378-aeab-fd14a689a026 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" acquired by "attach_volume" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:28 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=159,cinder:SELECT=130,cinder:DELETE=11,cinder:INSERT=44 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:37:28 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c586058c-400b-4378-aeab-fd14a689a026 tempest-VolumesActionsTest-1680247242 None] Attaching volume cd54b59f-d3b0-4d7e-afa6-1de7f04df906 to instance 5f13d76d-3ef8-4713-bdd0-7fb2e3c7d03e at mountpoint /dev/vdb on host None. Sep 11 21:37:28 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c586058c-400b-4378-aeab-fd14a689a026 tempest-VolumesActionsTest-1680247242 None] Attach volume completed successfully. Sep 11 21:37:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c586058c-400b-4378-aeab-fd14a689a026 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" released by "attach_volume" :: held 0.133s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e8d4e1f-a378-462d-b566-c7ad0ad135db tempest-VolumesActionsTest-1680247242 None] Acquiring lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906-detach_volume" by "detach_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:37:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e8d4e1f-a378-462d-b566-c7ad0ad135db tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:37:29 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8e8d4e1f-a378-462d-b566-c7ad0ad135db tempest-VolumesActionsTest-1680247242 None] Detaching volume cd54b59f-d3b0-4d7e-afa6-1de7f04df906 from instance 5f13d76d-3ef8-4713-bdd0-7fb2e3c7d03e. Sep 11 21:37:29 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8e8d4e1f-a378-462d-b566-c7ad0ad135db tempest-VolumesActionsTest-1680247242 None] Detach volume completed successfully. Sep 11 21:37:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8e8d4e1f-a378-462d-b566-c7ad0ad135db tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:37:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb338e3e-d0d7-4ce4-ab52-a9775f8a4fa7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:33 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 Sep 11 21:37:33 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:34 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" returned: 0 in 0.354s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:34 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1a4dd8-d186-438e-8262-e27f3a643de4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:34 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 Sep 11 21:37:34 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:34 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" returned: 0 in 0.350s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.d428287a-1ee1-4529-93c8-ffe3f0b1189b8fd2st2s.img {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:34 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.d428287a-1ee1-4529-93c8-ffe3f0b1189b8fd2st2s.img Sep 11 21:37:34 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:38 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.d428287a-1ee1-4529-93c8-ffe3f0b1189b8fd2st2s.img" returned: 0 in 3.767s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:38 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[01564d4b-1133-465e-a90f-a205b579b491]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:38 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 Sep 11 21:37:38 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:38 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" returned: 0 in 0.535s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:38 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906, size 1024.00 MB, duration 3.77 sec, destination /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.d428287a-1ee1-4529-93c8-ffe3f0b1189b8fd2st2s.img {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:37:38 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Converted 1024.00 MB image at 271.77 MB/s Sep 11 21:37:38 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] d428287a-1ee1-4529-93c8-ffe3f0b1189b was raw, no need to convert to raw {{(pid=87423) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 11 21:37:48 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:37:48 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:37:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.979s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:37:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Uploaded volume to glance image-id: d428287a-1ee1-4529-93c8-ffe3f0b1189b. {{(pid=87423) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 21:37:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3ddcaa83-efa5-46ac-8e59-e8f00dbc45e4 tempest-VolumesActionsTest-1680247242 None] Copy volume to image completed successfully. Sep 11 21:37:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:37:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:37:58 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[077343b3-7728-403c-ae09-43581c0a7cc8]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:58 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 Sep 11 21:37:58 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:59 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" returned: 0 in 0.348s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:59 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9298fd0-bc4e-40ec-b75b-bf9d841f1d19]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:37:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:59 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 Sep 11 21:37:59 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:37:59 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Sep 11 21:37:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" returned: 0 in 0.356s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:37:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:37:59 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img Sep 11 21:37:59 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:03 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img" returned: 0 in 3.616s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcb9fe4-e23a-4bca-81db-afd4b500dc02]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:03 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 Sep 11 21:38:03 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:03 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" returned: 0 in 0.519s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:03 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906, size 1024.00 MB, duration 3.62 sec, destination /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:38:03 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Converted 1024.00 MB image at 283.11 MB/s Sep 11 21:38:03 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] 88134963-07dd-4272-94ba-f11a409a26ab was raw, converting to qcow2 {{(pid=87423) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 11 21:38:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab48dda-e1e6-47d5-b98f-d5c326cc864f]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:03 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img Sep 11 21:38:03 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:04 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img" returned: 0 in 0.306s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:04 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img Sep 11 21:38:04 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:04 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img" returned: 1 in 0.307s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img /opt/stack/data/cinder/conversion/vol_upload_vc2za6uy {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:04 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img /opt/stack/data/cinder/conversion/vol_upload_vc2za6uy Sep 11 21:38:04 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:04 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img /opt/stack/data/cinder/conversion/vol_upload_vc2za6uy" returned: 0 in 0.254s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Image conversion details: src /opt/stack/data/cinder/conversion/cd54b59f-d3b0-4d7e-afa6-1de7f04df906.temp_image.88134963-07dd-4272-94ba-f11a409a26abe2xgwj81.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vc2za6uy {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:38:04 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c04df1-7c99-4df6-9170-dccf96c9dac8]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vc2za6uy {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:04 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vc2za6uy Sep 11 21:38:04 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:04 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vc2za6uy" returned: 0 in 0.309s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.252s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Uploaded volume to glance image-id: 88134963-07dd-4272-94ba-f11a409a26ab. {{(pid=87423) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 21:38:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-42c84a9a-b4dd-46e5-aae8-41737d50aaab tempest-VolumesActionsTest-1680247242 None] Copy volume to image completed successfully. Sep 11 21:38:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Acquiring lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:38:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:38:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Acquiring lock "cinder-quobyte-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:38:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-quobyte-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" acquired by "delete_volume" :: waited 0.013s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:38:06 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cd8234-be8a-413f-8340-c2bb43b33b78]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:06 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 Sep 11 21:38:06 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:07 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" returned: 0 in 0.345s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:07 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906 Sep 11 21:38:07 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:07 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" returned: 0 in 0.230s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-quobyte-cd54b59f-d3b0-4d7e-afa6-1de7f04df906" released by "delete_volume" :: held 0.607s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Created reservations ['aaf705ee-0157-422c-a2d1-03215d3ef7da', 'fb3dd041-8449-4840-ba1c-62282d2da114', '30e26f65-a2d3-4fa0-9f4a-aa73045f1f46', '2b5dd2e4-994c-4b27-8b21-08ee82dd2e7b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:07 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:38:07 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:07 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.245s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:38:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Deleted volume successfully. Sep 11 21:38:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-07612dca-91c7-40ca-a1ea-f6041a0d6ab3 tempest-VolumesActionsTest-1680247242 None] Lock "cinder-cd54b59f-d3b0-4d7e-afa6-1de7f04df906-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Flow 'volume_create_manager' (5d6fb9eb-66b0-4940-b12f-257b49520a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d52bf86-e309-4a11-917c-8423cc9efe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d52bf86-e309-4a11-917c-8423cc9efe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-890284374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae33ba07de7647b6aa17ca483bbd9c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:15Z,use_quota=True,user_id='9bf129ca461743899c198647c90eedbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de459311-2789-41c6-a592-055b2fd21af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de459311-2789-41c6-a592-055b2fd21af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0236fb-604c-4416-87d8-56e745916473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0236fb-604c-4416-87d8-56e745916473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e', 'volume_name': 'volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41731b41-8a78-4ff5-8a7f-262c93b5fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41731b41-8a78-4ff5-8a7f-262c93b5fa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9193bec-c5d6-48e4-a76a-85bc31c93dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:14 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Volume d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 21:38:14 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Trying to clone d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e from image 8333088b-528a-4438-98ec-37d49b129d98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:38:15 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Image download 20.69 MB at 20.69 MB/s Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8a4e3-013b-4932-88bf-e1172f1d0446]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:15 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD Sep 11 21:38:15 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:15 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 is fetched for user 9bf129ca461743899c198647c90eedbc. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a06c5-f0ee-4635-b2c1-f040e3b5aeb5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:15 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD Sep 11 21:38:15 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:15 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:38:15 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:15 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-890284374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae33ba07de7647b6aa17ca483bbd9c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:15Z,use_quota=True,user_id='9bf129ca461743899c198647c90eedbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Creating volume d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:38:15 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:38:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:15 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.244s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:38:16 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e 1073741824 Sep 11 21:38:16 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:16 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e 1073741824" returned: 0 in 0.411s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:16 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e Sep 11 21:38:16 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:16 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e" returned: 0 in 0.243s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Attempting download of 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d2f18-ff8e-45da-af5d-6dd09c3eb172]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_qvu96fkl {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:16 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_qvu96fkl Sep 11 21:38:16 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:17 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_qvu96fkl" returned: 0 in 0.310s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_qvu96fkl {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:17 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_qvu96fkl Sep 11 21:38:17 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:17 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_qvu96fkl" returned: 1 in 0.303s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8333088b-528a-4438-98ec-37d49b129d98_qvu96fkl' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:38:17 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[24988636-9a86-4904-abcd-de7c8dc23409]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:17 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD Sep 11 21:38:17 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:17 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:17 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] 8333088b-528a-4438-98ec-37d49b129d98 was qcow2, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:38:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:17 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e Sep 11 21:38:17 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:19 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e" returned: 0 in 1.507s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8333088b-528a-4438-98ec-37d49b129d98_xg0qren3devstack@QuobyteHD, size 112.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:38:19 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Converted 112.00 MB image at 74.23 MB/s Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:19 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e 1G Sep 11 21:38:19 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:19 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e 1G" returned: 0 in 0.300s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Downloaded image 8333088b-528a-4438-98ec-37d49b129d98 ((None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}])) to volume d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Temporary image 8333088b-528a-4438-98ec-37d49b129d98 for user 9bf129ca461743899c198647c90eedbc is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Marking volume d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Copying metadata from image 8333088b-528a-4438-98ec-37d49b129d98 to d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Creating volume glance metadata for volume d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e backed by image 8333088b-528a-4438-98ec-37d49b129d98 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9193bec-c5d6-48e4-a76a-85bc31c93dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e', 'volume_size': 1, 'image_id': '8333088b-528a-4438-98ec-37d49b129d98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8333088b-528a-4438-98ec-37d49b129d98', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd1f2b0e62fe4901aacc93e0d32d6f5a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8333088b-528a-4438-98ec-37d49b129d98', 'created_at': datetime.datetime(2026, 9, 11, 19, 16, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 16, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8333088b-528a-4438-98ec-37d49b129d98/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91150b6-5aae-4059-97e1-741531cd692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:19 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Volume volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e (d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e): created successfully Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91150b6-5aae-4059-97e1-741531cd692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:19 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Flow 'volume_create_manager' (5d6fb9eb-66b0-4940-b12f-257b49520a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:38:19 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-16fcd8b5-8e59-4a0b-8fc5-98d55c72d240 tempest-VolumesExtendTest-845179756 None] Created volume successfully. Sep 11 21:38:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8124f344-ed0f-4d91-a83e-6c722cd3b377 tempest-VolumesExtendTest-845179756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8124f344-ed0f-4d91-a83e-6c722cd3b377 tempest-VolumesExtendTest-845179756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b1d927-edc4-45f4-99b2-1a50a52cea2e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8124f344-ed0f-4d91-a83e-6c722cd3b377 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:20 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e Sep 11 21:38:20 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:20 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8124f344-ed0f-4d91-a83e-6c722cd3b377 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e" returned: 0 in 0.345s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8124f344-ed0f-4d91-a83e-6c722cd3b377 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e 2G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8124f344-ed0f-4d91-a83e-6c722cd3b377 tempest-VolumesExtendTest-845179756 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e 2G" returned: 0 in 0.089s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8124f344-ed0f-4d91-a83e-6c722cd3b377 tempest-VolumesExtendTest-845179756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.459s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:20 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8124f344-ed0f-4d91-a83e-6c722cd3b377 tempest-VolumesExtendTest-845179756 None] Extend volume completed successfully. Sep 11 21:38:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Acquiring lock "cinder-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:38:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Lock "cinder-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:38:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Acquiring lock "cinder-quobyte-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:38:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Lock "cinder-quobyte-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:38:21 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a457dd99-9b3f-4d4c-a117-521890d312d3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:21 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e Sep 11 21:38:21 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:21 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e" returned: 0 in 0.380s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:21 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e Sep 11 21:38:21 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:22 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e" returned: 0 in 0.257s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Lock "cinder-quobyte-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e" released by "delete_volume" :: held 0.673s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Created reservations ['2bf0ec9f-9875-46f8-a0ac-cacbee43352a', 'b80ffbb8-4e20-4666-9c16-6dcd47b9b942', '23b75b1b-2456-493b-b48f-b6df126a6dd1', '10880d30-a029-4355-b298-0c993eb8ec4c'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:22 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:38:22 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:22 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.262s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:38:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Deleted volume successfully. Sep 11 21:38:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-db409456-f463-4a62-87b5-99f3a57464b6 tempest-VolumesExtendTest-845179756 None] Lock "cinder-d4fd07b4-a0ef-472f-a2d3-04a6ef9ab40e-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Flow 'volume_create_manager' (80940377-5448-4938-8fce-5f7a553db999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1dcb88-27e7-47d9-b0c5-26e04211aae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1dcb88-27e7-47d9-b0c5-26e04211aae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2069593027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b565fc-facc-4d54-b8ce-f8596b773c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae33ba07de7647b6aa17ca483bbd9c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:23Z,use_quota=True,user_id='9bf129ca461743899c198647c90eedbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319c6ed2-bf94-4e4c-8ca4-b0e951ab9ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319c6ed2-bf94-4e4c-8ca4-b0e951ab9ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef7176d-e3f1-464e-b6ad-287f9ea042e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef7176d-e3f1-464e-b6ad-287f9ea042e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b565fc-facc-4d54-b8ce-f8596b773c84', 'volume_name': 'volume-73b565fc-facc-4d54-b8ce-f8596b773c84', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d182d5-7426-48b5-be95-9dba5eac37fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d182d5-7426-48b5-be95-9dba5eac37fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86762e43-049c-4bb5-b796-eb75a83af8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:23 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Volume 73b565fc-facc-4d54-b8ce-f8596b773c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b565fc-facc-4d54-b8ce-f8596b773c84', 'volume_size': 1} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2069593027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b565fc-facc-4d54-b8ce-f8596b773c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae33ba07de7647b6aa17ca483bbd9c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:23Z,use_quota=True,user_id='9bf129ca461743899c198647c90eedbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Creating volume 73b565fc-facc-4d54-b8ce-f8596b773c84 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:38:23 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:23 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 1073741824 Sep 11 21:38:23 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:23 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 1073741824" returned: 0 in 0.399s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:23 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 Sep 11 21:38:23 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:23 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84" returned: 0 in 0.253s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86762e43-049c-4bb5-b796-eb75a83af8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b565fc-facc-4d54-b8ce-f8596b773c84', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca972043-b103-4e67-9442-5d930eb4d8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:23 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Volume volume-73b565fc-facc-4d54-b8ce-f8596b773c84 (73b565fc-facc-4d54-b8ce-f8596b773c84): created successfully Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca972043-b103-4e67-9442-5d930eb4d8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Flow 'volume_create_manager' (80940377-5448-4938-8fce-5f7a553db999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:38:23 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-055c341b-99c5-4efe-b350-6a681dc607bd tempest-VolumesExtendTest-845179756 None] Created volume successfully. Sep 11 21:38:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Creating offline snapshot 00434734-800d-4f57-9618-2536589ee89a of volume 73b565fc-facc-4d54-b8ce-f8596b773c84 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:38:24 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[583c719b-4db7-4c8a-9fb6-c810d3d83890]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:24 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 Sep 11 21:38:24 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:24 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84" returned: 0 in 0.345s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:24 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a 1G Sep 11 21:38:24 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:25 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a 1G" returned: 0 in 0.378s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b565fc-facc-4d54-b8ce-f8596b773c84 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:25 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b565fc-facc-4d54-b8ce-f8596b773c84 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a Sep 11 21:38:25 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:25 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b565fc-facc-4d54-b8ce-f8596b773c84 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:25 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a is being set with open permissions: ugo+rw Sep 11 21:38:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:25 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a Sep 11 21:38:25 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:25 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a" returned: 0 in 0.245s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:25 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.info Sep 11 21:38:25 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:25 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.info" returned: 0 in 0.242s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:25 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.info is being set with open permissions: ugo+rw Sep 11 21:38:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:25 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.info Sep 11 21:38:25 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:26 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.info" returned: 0 in 0.235s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:26 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4fed6c5e-55c6-4b8b-8bb9-d6357b4814ee tempest-VolumesExtendTest-845179756 None] Create snapshot completed successfully Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e95b10f3-fa3d-499b-b191-9e496bd7b066 tempest-VolumesExtendTest-845179756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e95b10f3-fa3d-499b-b191-9e496bd7b066 tempest-VolumesExtendTest-845179756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c40897-bd83-4455-90b5-4b93e522b07b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e95b10f3-fa3d-499b-b191-9e496bd7b066 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:26 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 Sep 11 21:38:26 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:26 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e95b10f3-fa3d-499b-b191-9e496bd7b066 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84" returned: 0 in 0.350s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e95b10f3-fa3d-499b-b191-9e496bd7b066 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a 2G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e95b10f3-fa3d-499b-b191-9e496bd7b066 tempest-VolumesExtendTest-845179756 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a 2G" returned: 0 in 0.110s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e95b10f3-fa3d-499b-b191-9e496bd7b066 tempest-VolumesExtendTest-845179756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.490s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:27 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e95b10f3-fa3d-499b-b191-9e496bd7b066 tempest-VolumesExtendTest-845179756 None] Extend volume completed successfully. Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Acquiring lock "cinder-00434734-800d-4f57-9618-2536589ee89a-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Lock "cinder-00434734-800d-4f57-9618-2536589ee89a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Acquiring lock "cinder-quobyte-73b565fc-facc-4d54-b8ce-f8596b773c84" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Lock "cinder-quobyte-73b565fc-facc-4d54-b8ce-f8596b773c84" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Acquiring lock "cinder-quobyte-00434734-800d-4f57-9618-2536589ee89a" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Lock "cinder-quobyte-00434734-800d-4f57-9618-2536589ee89a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Deleting offline snapshot 00434734-800d-4f57-9618-2536589ee89a of volume 73b565fc-facc-4d54-b8ce-f8596b773c84 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] snapshot_file for this snap is: volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[87064db3-fc3a-4955-8723-7299a41c2adb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:27 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a Sep 11 21:38:27 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:28 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a" returned: 0 in 0.366s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73b565fc-facc-4d54-b8ce-f8596b773c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:38:28 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a5fcb9-dfcb-4ce6-b74c-262ad1d1aaa4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:28 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 Sep 11 21:38:28 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:28 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84" returned: 0 in 0.349s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:28 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a Sep 11 21:38:28 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:28 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a" returned: 0 in 0.395s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:28 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a Sep 11 21:38:28 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:29 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84.00434734-800d-4f57-9618-2536589ee89a" returned: 0 in 0.253s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Lock "cinder-quobyte-00434734-800d-4f57-9618-2536589ee89a" released by "_delete_snapshot" :: held 1.461s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:38:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Lock "cinder-quobyte-73b565fc-facc-4d54-b8ce-f8596b773c84" released by "delete_snapshot" :: held 1.483s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:38:29 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Created reservations ['5370e3e1-dcb5-4582-95a1-e6a1747dcab7', '4ff9341c-ecba-44dc-8529-e5d6eb0e6b18', 'ce75aab1-b168-43ed-b083-e1ef5474b8fd', 'cb4ca06f-fcfa-4544-9a1a-752f2311d00f'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:38:29 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Delete snapshot completed successfully. Sep 11 21:38:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ed4a5ca7-7096-4ffc-be4a-136b3009cde4 tempest-VolumesExtendTest-845179756 None] Lock "cinder-00434734-800d-4f57-9618-2536589ee89a-delete_snapshot" released by "delete_snapshot" :: held 1.611s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:38:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Acquiring lock "cinder-73b565fc-facc-4d54-b8ce-f8596b773c84-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:38:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Lock "cinder-73b565fc-facc-4d54-b8ce-f8596b773c84-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:38:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Acquiring lock "cinder-quobyte-73b565fc-facc-4d54-b8ce-f8596b773c84" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:38:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Lock "cinder-quobyte-73b565fc-facc-4d54-b8ce-f8596b773c84" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc630c06-c0b9-46a2-80ed-44de7f3f2b26]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:30 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 Sep 11 21:38:30 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:30 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84" returned: 0 in 0.353s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:30 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84 Sep 11 21:38:30 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:30 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-73b565fc-facc-4d54-b8ce-f8596b773c84" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Lock "cinder-quobyte-73b565fc-facc-4d54-b8ce-f8596b773c84" released by "delete_volume" :: held 0.649s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Created reservations ['34d706a2-c7f7-4158-bf4a-335c2114bdc8', '9cfed166-a845-42b3-bea8-36d05076eba7', '46790642-b406-4d78-b2e8-936281d015aa', '947e3a62-98dd-4a2b-8f82-f95577fbd427'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:30 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:38:30 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:31 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.268s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:31 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:38:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Deleted volume successfully. Sep 11 21:38:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-02179a6f-9e71-418e-a8e7-e8c7003e2c66 tempest-VolumesExtendTest-845179756 None] Lock "cinder-73b565fc-facc-4d54-b8ce-f8596b773c84-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:38:40 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=43,cinder:UPDATE=40,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:38:41 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=49,cinder:SELECT=39,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Flow 'volume_create_manager' (dbcd0e8a-3533-4967-9c30-0b57616683eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8ee0cf-fe38-457e-ae10-35101819e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8ee0cf-fe38-457e-ae10-35101819e8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1812178629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853e960d-7ba6-46d9-94f0-5bff3c62bc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245ad94f2aa84b6f915fe7fe8c96fbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:57Z,use_quota=True,user_id='6d20c80d64e54cff8c9629fa28d1f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06d33061-decf-4f1d-a22f-6865b9ad03bc),volume_type_id=06d33061-decf-4f1d-a22f-6865b9ad03bc)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f88c263-115f-4af8-96cd-09d4d1ea3666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f88c263-115f-4af8-96cd-09d4d1ea3666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b14803-9120-42b5-a1a9-c01be5c7c5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b14803-9120-42b5-a1a9-c01be5c7c5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853e960d-7ba6-46d9-94f0-5bff3c62bc2d', 'volume_name': 'volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d893b524-b99f-4e57-99a8-fca62816faab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d893b524-b99f-4e57-99a8-fca62816faab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d206ab32-61a3-420e-b04b-c998b0eb0171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Volume 853e960d-7ba6-46d9-94f0-5bff3c62bc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d', 'volume_size': 1} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1812178629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853e960d-7ba6-46d9-94f0-5bff3c62bc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245ad94f2aa84b6f915fe7fe8c96fbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:57Z,use_quota=True,user_id='6d20c80d64e54cff8c9629fa28d1f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06d33061-decf-4f1d-a22f-6865b9ad03bc),volume_type_id=06d33061-decf-4f1d-a22f-6865b9ad03bc)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Creating volume 853e960d-7ba6-46d9-94f0-5bff3c62bc2d {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:38:57 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:57 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d 1073741824 Sep 11 21:38:57 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Flow 'volume_create_manager' (2bd9a359-ea13-4852-8d1e-7e63b83824ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239e6a2d-fa60-4fed-b9fe-775dfd9efb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239e6a2d-fa60-4fed-b9fe-775dfd9efb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1284779395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3811c1-6a0d-4805-bd64-eb457e9bfd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245ad94f2aa84b6f915fe7fe8c96fbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:58Z,use_quota=True,user_id='6d20c80d64e54cff8c9629fa28d1f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1abae155-bd71-4525-8f00-e537bcd27459),volume_type_id=1abae155-bd71-4525-8f00-e537bcd27459)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e807501-6f75-4623-8eec-b3797530b5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e807501-6f75-4623-8eec-b3797530b5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba97dbe-0b80-4cf1-a01a-77214ed8d0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba97dbe-0b80-4cf1-a01a-77214ed8d0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3811c1-6a0d-4805-bd64-eb457e9bfd32', 'volume_name': 'volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119c6c0c-8340-4d13-8862-6d7f3328fb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119c6c0c-8340-4d13-8862-6d7f3328fb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7701509-f8e0-4bf1-a52a-45216dd1d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Volume 8b3811c1-6a0d-4805-bd64-eb457e9bfd32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32', 'volume_size': 1} Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:57 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d 1073741824" returned: 0 in 0.506s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:58 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d Sep 11 21:38:58 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:58 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d" returned: 0 in 0.251s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.353s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1284779395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3811c1-6a0d-4805-bd64-eb457e9bfd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245ad94f2aa84b6f915fe7fe8c96fbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:58Z,use_quota=True,user_id='6d20c80d64e54cff8c9629fa28d1f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1abae155-bd71-4525-8f00-e537bcd27459),volume_type_id=1abae155-bd71-4525-8f00-e537bcd27459)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Creating volume 8b3811c1-6a0d-4805-bd64-eb457e9bfd32 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:38:58 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d206ab32-61a3-420e-b04b-c998b0eb0171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ace1a1b-fb44-45bf-8a73-4d57d0bb590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:58 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 1073741824 Sep 11 21:38:58 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:58 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Volume volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d (853e960d-7ba6-46d9-94f0-5bff3c62bc2d): created successfully Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ace1a1b-fb44-45bf-8a73-4d57d0bb590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Flow 'volume_create_manager' (dbcd0e8a-3533-4967-9c30-0b57616683eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:38:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e9a4f29b-a0a0-4b97-ae32-6f4d43c314c0 tempest-TestInstancesWithCinderVolumes-1317693677 None] Created volume successfully. Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Flow 'volume_create_manager' (e595f224-b773-47fd-9ed8-60d0b10b7ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff3f79c-58de-4ebb-8744-efcd01e062b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff3f79c-58de-4ebb-8744-efcd01e062b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1880180717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd33081c-84cf-4019-a6ea-5f545b6bc54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245ad94f2aa84b6f915fe7fe8c96fbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:58Z,use_quota=True,user_id='6d20c80d64e54cff8c9629fa28d1f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd526676-c18a-4f92-92bc-1d351823840f),volume_type_id=bd526676-c18a-4f92-92bc-1d351823840f)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2888952a-2f2d-49cb-86eb-928a3248c75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2888952a-2f2d-49cb-86eb-928a3248c75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68419e23-4c5c-4e4e-b6a4-7c4dde2f0333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:38:58 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 1073741824" returned: 0 in 0.453s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:38:58 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 Sep 11 21:38:58 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68419e23-4c5c-4e4e-b6a4-7c4dde2f0333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd33081c-84cf-4019-a6ea-5f545b6bc54d', 'volume_name': 'volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d', 'volume_size': 1, 'image_id': '55042b0a-7d79-4a23-b28c-0c27023e5d44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55042b0a-7d79-4a23-b28c-0c27023e5d44', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--93861975', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '245ad94f2aa84b6f915fe7fe8c96fbc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55042b0a-7d79-4a23-b28c-0c27023e5d44', 'created_at': datetime.datetime(2026, 9, 11, 19, 38, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 38, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55042b0a-7d79-4a23-b28c-0c27023e5d44/file', 'properties': {}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1908ac6c-e0a3-4852-beaa-cc206ed96b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1908ac6c-e0a3-4852-beaa-cc206ed96b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4d0c3c-94ab-4e0e-88e6-ec79d427d0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:58 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Volume bd33081c-84cf-4019-a6ea-5f545b6bc54d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d', 'volume_size': 1, 'image_id': '55042b0a-7d79-4a23-b28c-0c27023e5d44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55042b0a-7d79-4a23-b28c-0c27023e5d44', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--93861975', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '245ad94f2aa84b6f915fe7fe8c96fbc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55042b0a-7d79-4a23-b28c-0c27023e5d44', 'created_at': datetime.datetime(2026, 9, 11, 19, 38, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 38, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55042b0a-7d79-4a23-b28c-0c27023e5d44/file', 'properties': {}}, 'image_service': } Sep 11 21:38:58 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Trying to clone bd33081c-84cf-4019-a6ea-5f545b6bc54d from image 55042b0a-7d79-4a23-b28c-0c27023e5d44 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55042b0a-7d79-4a23-b28c-0c27023e5d44', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:38:59 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Sep 11 21:38:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32" returned: 0 in 0.255s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:38:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:38:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:38:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7701509-f8e0-4bf1-a52a-45216dd1d319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc0c665-6020-46c5-b80e-2bbaf7e315ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:38:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Volume volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 (8b3811c1-6a0d-4805-bd64-eb457e9bfd32): created successfully Sep 11 21:38:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc0c665-6020-46c5-b80e-2bbaf7e315ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:38:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Flow 'volume_create_manager' (2bd9a359-ea13-4852-8d1e-7e63b83824ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:38:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c4ab661e-3051-4dc9-a21e-90317b0d8a2c tempest-TestInstancesWithCinderVolumes-1317693677 None] Created volume successfully. Sep 11 21:39:01 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD, size 20.69 MB, duration 2.72 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:39:01 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Image download 20.69 MB at 7.60 MB/s Sep 11 21:39:01 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a308d1e-0eff-41a7-9df0-3eb85959e9b9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:39:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:01 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD Sep 11 21:39:01 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:01 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:01 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Temporary image 55042b0a-7d79-4a23-b28c-0c27023e5d44 is fetched for user 6d20c80d64e54cff8c9629fa28d1f21f. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c094694b-e924-44d1-8514-41557e9c65c2]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:02 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD Sep 11 21:39:02 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:02 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1880180717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd33081c-84cf-4019-a6ea-5f545b6bc54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245ad94f2aa84b6f915fe7fe8c96fbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:38:58Z,use_quota=True,user_id='6d20c80d64e54cff8c9629fa28d1f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd526676-c18a-4f92-92bc-1d351823840f),volume_type_id=bd526676-c18a-4f92-92bc-1d351823840f)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Creating volume bd33081c-84cf-4019-a6ea-5f545b6bc54d {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:39:02 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:02 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d 1073741824 Sep 11 21:39:02 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:02 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d 1073741824" returned: 0 in 0.444s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:02 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d Sep 11 21:39:02 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:03 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d" returned: 0 in 0.246s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Attempting download of 55042b0a-7d79-4a23-b28c-0c27023e5d44 ((None, [{'url': 'file:///opt/stack/data/glance/images/55042b0a-7d79-4a23-b28c-0c27023e5d44', 'metadata': {}}])) to volume bd33081c-84cf-4019-a6ea-5f545b6bc54d. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd7e013-e472-4777-aca3-090ae322f7dd]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55042b0a-7d79-4a23-b28c-0c27023e5d44_erf0kge1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:03 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55042b0a-7d79-4a23-b28c-0c27023e5d44_erf0kge1 Sep 11 21:39:03 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:03 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55042b0a-7d79-4a23-b28c-0c27023e5d44_erf0kge1" returned: 0 in 0.330s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55042b0a-7d79-4a23-b28c-0c27023e5d44_erf0kge1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:03 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55042b0a-7d79-4a23-b28c-0c27023e5d44_erf0kge1 Sep 11 21:39:03 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:03 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55042b0a-7d79-4a23-b28c-0c27023e5d44_erf0kge1" returned: 1 in 0.334s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55042b0a-7d79-4a23-b28c-0c27023e5d44_erf0kge1' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c618857f-6ebf-411b-8ef7-db7ce18fe8dd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:39:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:03 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD Sep 11 21:39:03 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:04 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:04 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] 55042b0a-7d79-4a23-b28c-0c27023e5d44 was qcow2, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:39:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:04 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d Sep 11 21:39:04 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:05 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d" returned: 0 in 1.565s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:05 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55042b0a-7d79-4a23-b28c-0c27023e5d44_ncwpt3c7devstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:39:05 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Converted 112.00 MB image at 71.48 MB/s Sep 11 21:39:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:05 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d 1G Sep 11 21:39:05 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:06 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d 1G" returned: 0 in 0.300s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Downloaded image 55042b0a-7d79-4a23-b28c-0c27023e5d44 ((None, [{'url': 'file:///opt/stack/data/glance/images/55042b0a-7d79-4a23-b28c-0c27023e5d44', 'metadata': {}}])) to volume bd33081c-84cf-4019-a6ea-5f545b6bc54d successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Temporary image 55042b0a-7d79-4a23-b28c-0c27023e5d44 for user 6d20c80d64e54cff8c9629fa28d1f21f is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Marking volume bd33081c-84cf-4019-a6ea-5f545b6bc54d as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Copying metadata from image 55042b0a-7d79-4a23-b28c-0c27023e5d44 to bd33081c-84cf-4019-a6ea-5f545b6bc54d. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Creating volume glance metadata for volume bd33081c-84cf-4019-a6ea-5f545b6bc54d backed by image 55042b0a-7d79-4a23-b28c-0c27023e5d44 with: {'image_id': '55042b0a-7d79-4a23-b28c-0c27023e5d44', 'image_name': 'tempest-scenario-img--93861975', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4d0c3c-94ab-4e0e-88e6-ec79d427d0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d', 'volume_size': 1, 'image_id': '55042b0a-7d79-4a23-b28c-0c27023e5d44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55042b0a-7d79-4a23-b28c-0c27023e5d44', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--93861975', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '245ad94f2aa84b6f915fe7fe8c96fbc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55042b0a-7d79-4a23-b28c-0c27023e5d44', 'created_at': datetime.datetime(2026, 9, 11, 19, 38, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 38, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55042b0a-7d79-4a23-b28c-0c27023e5d44/file', 'properties': {}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7696f819-1a2b-436c-85bb-88455280fc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:39:06 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Volume volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d (bd33081c-84cf-4019-a6ea-5f545b6bc54d): created successfully Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7696f819-1a2b-436c-85bb-88455280fc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:39:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Flow 'volume_create_manager' (e595f224-b773-47fd-9ed8-60d0b10b7ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:39:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5c5d00ef-197c-4f2b-a4ca-fd688421453b tempest-TestInstancesWithCinderVolumes-1317693677 None] Created volume successfully. Sep 11 21:39:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-ba1de7ac-64f0-407d-bd32-6d25362b9273 req-a12219c4-02ed-4c3f-acd9-ab709e19d5c5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:39:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-ba1de7ac-64f0-407d-bd32-6d25362b9273 req-a12219c4-02ed-4c3f-acd9-ab709e19d5c5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:39:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-ba1de7ac-64f0-407d-bd32-6d25362b9273 req-a12219c4-02ed-4c3f-acd9-ab709e19d5c5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:39:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-ba1de7ac-64f0-407d-bd32-6d25362b9273 req-a12219c4-02ed-4c3f-acd9-ab709e19d5c5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5595de5b-08af-46dc-a897-03b1ab9126f3', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:39:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-ba1de7ac-64f0-407d-bd32-6d25362b9273 req-a12219c4-02ed-4c3f-acd9-ab709e19d5c5 tempest-TestInstancesWithCinderVolumes-1317693677 None] attachment_update completed successfully. Sep 11 21:39:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:39:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:39:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:39:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:39:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:39:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:39:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:15 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:39:15 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:16 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.288s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:39:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:39:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:39:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:39:20 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=19,cinder:UPDATE=9,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:39:20 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:39:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-70453919-c1a5-48a2-b0f9-49841f43d43b req-77aac515-ac14-4e2f-b1f2-2191139d8b53 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:39:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-70453919-c1a5-48a2-b0f9-49841f43d43b req-77aac515-ac14-4e2f-b1f2-2191139d8b53 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:39:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-70453919-c1a5-48a2-b0f9-49841f43d43b req-77aac515-ac14-4e2f-b1f2-2191139d8b53 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:39:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-70453919-c1a5-48a2-b0f9-49841f43d43b req-77aac515-ac14-4e2f-b1f2-2191139d8b53 tempest-TestInstancesWithCinderVolumes-1317693677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b80e35ed-83de-43c3-b005-1475a5627c93', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:39:40 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-70453919-c1a5-48a2-b0f9-49841f43d43b req-77aac515-ac14-4e2f-b1f2-2191139d8b53 tempest-TestInstancesWithCinderVolumes-1317693677 None] attachment_update completed successfully. Sep 11 21:39:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-8d03204e-fc4c-4459-9794-c3e5c3517763 req-cd90ac6b-906e-4e9e-ac76-ae047e79fb42 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:39:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-8d03204e-fc4c-4459-9794-c3e5c3517763 req-cd90ac6b-906e-4e9e-ac76-ae047e79fb42 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:39:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-8d03204e-fc4c-4459-9794-c3e5c3517763 req-cd90ac6b-906e-4e9e-ac76-ae047e79fb42 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:39:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-8d03204e-fc4c-4459-9794-c3e5c3517763 req-cd90ac6b-906e-4e9e-ac76-ae047e79fb42 tempest-TestInstancesWithCinderVolumes-1317693677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1ee93ed-e40d-4076-bb09-f7fd80683b71', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:39:42 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-8d03204e-fc4c-4459-9794-c3e5c3517763 req-cd90ac6b-906e-4e9e-ac76-ae047e79fb42 tempest-TestInstancesWithCinderVolumes-1317693677 None] attachment_update completed successfully. Sep 11 21:39:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-745f6fec-935e-4642-b7fa-103f1c26b028 req-c2249bfa-c98a-45d2-84ae-c8d8aabec1e3 tempest-TestInstancesWithCinderVolumes-1317693677 None] Terminate volume connection completed successfully. Sep 11 21:39:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-745f6fec-935e-4642-b7fa-103f1c26b028 req-c2249bfa-c98a-45d2-84ae-c8d8aabec1e3 tempest-TestInstancesWithCinderVolumes-1317693677 None] Deleting attachment b80e35ed-83de-43c3-b005-1475a5627c93. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:39:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "cinder-853e960d-7ba6-46d9-94f0-5bff3c62bc2d-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:39:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-853e960d-7ba6-46d9-94f0-5bff3c62bc2d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:39:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "cinder-quobyte-853e960d-7ba6-46d9-94f0-5bff3c62bc2d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:39:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-quobyte-853e960d-7ba6-46d9-94f0-5bff3c62bc2d" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:39:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab7de1b-2658-4b3c-bda5-7c0976278982]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:39:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:47 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d Sep 11 21:39:47 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:48 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:48 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d Sep 11 21:39:48 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:48 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-853e960d-7ba6-46d9-94f0-5bff3c62bc2d" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-quobyte-853e960d-7ba6-46d9-94f0-5bff3c62bc2d" released by "delete_volume" :: held 0.695s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:39:48 devstack cinder-volume[87423]: WARNING cinder.quota [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1227930886-1480275596 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1227930886-1480275596, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:39:48 devstack cinder-volume[87423]: WARNING cinder.quota [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1227930886-1480275596 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1227930886-1480275596, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Created reservations ['420f4469-de62-45ae-a310-12bf97dfe8d5', 'a5cd01de-8cdf-4383-abf3-4b4f4f75aae8', '94c279dd-d578-41f8-99e2-32bad8693417', '21edf849-b06e-44d3-8881-9f05cf5a32c6'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:48 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:39:48 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:48 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.259s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:39:48 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Deleted volume successfully. Sep 11 21:39:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c0374590-ab79-4430-a0d9-30d6b39a0db5 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-853e960d-7ba6-46d9-94f0-5bff3c62bc2d-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:39:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-2673a208-ecc9-46ad-aa6d-1b11f5467160 req-8b662938-d663-49d3-b478-9532107f0c68 tempest-TestInstancesWithCinderVolumes-1317693677 None] Terminate volume connection completed successfully. Sep 11 21:39:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-2673a208-ecc9-46ad-aa6d-1b11f5467160 req-8b662938-d663-49d3-b478-9532107f0c68 tempest-TestInstancesWithCinderVolumes-1317693677 None] Deleting attachment d1ee93ed-e40d-4076-bb09-f7fd80683b71. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:39:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "cinder-8b3811c1-6a0d-4805-bd64-eb457e9bfd32-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:39:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-8b3811c1-6a0d-4805-bd64-eb457e9bfd32-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:39:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "cinder-quobyte-8b3811c1-6a0d-4805-bd64-eb457e9bfd32" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:39:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-quobyte-8b3811c1-6a0d-4805-bd64-eb457e9bfd32" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:39:51 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[703f2c3f-b7aa-40dd-94cd-8cdb4194011c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:39:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:51 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 Sep 11 21:39:51 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:52 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32" returned: 0 in 0.370s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:52 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32 Sep 11 21:39:52 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:52 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8b3811c1-6a0d-4805-bd64-eb457e9bfd32" returned: 0 in 0.257s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-quobyte-8b3811c1-6a0d-4805-bd64-eb457e9bfd32" released by "delete_volume" :: held 0.670s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:39:52 devstack cinder-volume[87423]: WARNING cinder.quota [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-541072651-547476488 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-541072651-547476488, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:39:52 devstack cinder-volume[87423]: WARNING cinder.quota [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-541072651-547476488 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-541072651-547476488, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Created reservations ['e473fe17-cbc7-4b09-8ac9-434adbc8c6e3', '9e877a81-ae18-4c5f-bff0-59170ce3b2d2', '9e18e298-fcf9-476c-9797-b691e9df613e', '41beefdd-7379-4ae0-a79b-56f5276015ff'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:52 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:39:52 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:52 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.308s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:39:52 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Deleted volume successfully. Sep 11 21:39:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-11f60a13-175d-4413-bea8-58348951fd7d tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-8b3811c1-6a0d-4805-bd64-eb457e9bfd32-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:39:55 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-c6f99a6c-23ef-4c86-a6a8-8bbfb027130c req-acaf230e-4f86-4558-801f-f185cb326701 tempest-TestInstancesWithCinderVolumes-1317693677 None] Terminate volume connection completed successfully. Sep 11 21:39:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-c6f99a6c-23ef-4c86-a6a8-8bbfb027130c req-acaf230e-4f86-4558-801f-f185cb326701 tempest-TestInstancesWithCinderVolumes-1317693677 None] Deleting attachment 5595de5b-08af-46dc-a897-03b1ab9126f3. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:39:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "cinder-bd33081c-84cf-4019-a6ea-5f545b6bc54d-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:39:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-bd33081c-84cf-4019-a6ea-5f545b6bc54d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:39:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "cinder-quobyte-bd33081c-84cf-4019-a6ea-5f545b6bc54d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:39:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-quobyte-bd33081c-84cf-4019-a6ea-5f545b6bc54d" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:39:56 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1054e804-6839-4eb7-9e01-3fa66568418f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:39:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:56 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d Sep 11 21:39:56 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:57 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d" returned: 0 in 0.356s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:57 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d Sep 11 21:39:57 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:57 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bd33081c-84cf-4019-a6ea-5f545b6bc54d" returned: 0 in 0.243s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-quobyte-bd33081c-84cf-4019-a6ea-5f545b6bc54d" released by "delete_volume" :: held 0.637s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:39:57 devstack cinder-volume[87423]: WARNING cinder.quota [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1102607139-1646236473 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1102607139-1646236473, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:39:57 devstack cinder-volume[87423]: WARNING cinder.quota [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1102607139-1646236473 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1102607139-1646236473, it is now deprecated. Please use the default quota class for default quota. Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Created reservations ['627caa38-85f5-419f-9176-d5a77132c067', 'ef0ff1cf-3b62-4e59-9410-f0ea4b6a5659', 'bd657256-7391-4538-a2c2-cbaacbc33e49', '494ec58c-4977-4f82-bbeb-7224b7527d34'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:39:57 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:39:57 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:39:57 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.236s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:39:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Deleted volume successfully. Sep 11 21:39:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-68a6560f-11c1-40e1-8765-b15e782f4b90 tempest-TestInstancesWithCinderVolumes-1317693677 None] Lock "cinder-bd33081c-84cf-4019-a6ea-5f545b6bc54d-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:40:07 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=34,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:40:07 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=28,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:40:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:40:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:40:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:40:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:40:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:40:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:40:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:40:15 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:40:15 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:40:16 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 11 21:40:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.249s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:40:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:40:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:40:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:40:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Flow 'volume_create_manager' (39a3c616-2d59-4c54-86b4-f1cd136d4906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c760f4-faf6-4a23-9cdd-ee5d233c79e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c760f4-faf6-4a23-9cdd-ee5d233c79e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1220261228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e92f0e46222446880bac02045866505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:40:57Z,use_quota=True,user_id='a99c962488c54d1fa95d798acb2ef644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffff3bdf-b156-4be6-89ec-ef23db85577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffff3bdf-b156-4be6-89ec-ef23db85577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e661d9af-a565-44d0-bc3d-0a2b8d79db0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e661d9af-a565-44d0-bc3d-0a2b8d79db0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c', 'volume_name': 'volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dda9b7b-8154-43fd-9aaf-9b523d1bcca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dda9b7b-8154-43fd-9aaf-9b523d1bcca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da81808a-917a-4312-a96c-cf1514436fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:40:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Volume c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c', 'volume_size': 1} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1220261228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e92f0e46222446880bac02045866505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:40:57Z,use_quota=True,user_id='a99c962488c54d1fa95d798acb2ef644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Creating volume c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:40:57 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:40:57 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c 1073741824 Sep 11 21:40:57 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:40:57 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c 1073741824" returned: 0 in 0.410s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:40:57 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c Sep 11 21:40:57 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:40:57 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c" returned: 0 in 0.246s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da81808a-917a-4312-a96c-cf1514436fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e330d33-5af8-49a2-b1f8-5193833b37e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:40:57 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Volume volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c (c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c): created successfully Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e330d33-5af8-49a2-b1f8-5193833b37e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:40:57 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Flow 'volume_create_manager' (39a3c616-2d59-4c54-86b4-f1cd136d4906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:40:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a193a168-1707-4f32-8ae9-d5bcea69c4c1 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Created volume successfully. Sep 11 21:40:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-3d8f320b-fbed-42e9-b7e2-db53b33537b9 req-46e9f097-038a-401b-8443-7c0790764899 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:40:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-3d8f320b-fbed-42e9-b7e2-db53b33537b9 req-46e9f097-038a-401b-8443-7c0790764899 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:40:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [req-3d8f320b-fbed-42e9-b7e2-db53b33537b9 req-46e9f097-038a-401b-8443-7c0790764899 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:40:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-3d8f320b-fbed-42e9-b7e2-db53b33537b9 req-46e9f097-038a-401b-8443-7c0790764899 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64', 'name': 'volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '113f4272-f235-42a7-be3c-4238d690e3e5', 'enforce_multipath': True} {{(pid=87423) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 21:40:58 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-3d8f320b-fbed-42e9-b7e2-db53b33537b9 req-46e9f097-038a-401b-8443-7c0790764899 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] attachment_update completed successfully. Sep 11 21:41:00 devstack cinder-volume[87423]: INFO cinder.volume.manager [req-7d9402c5-8947-4a3a-b489-a3035e234898 req-54e9f18b-8b8c-42d7-8822-5914ec205582 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Terminate volume connection completed successfully. Sep 11 21:41:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [req-7d9402c5-8947-4a3a-b489-a3035e234898 req-54e9f18b-8b8c-42d7-8822-5914ec205582 tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Deleting attachment 113f4272-f235-42a7-be3c-4238d690e3e5. {{(pid=87423) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 21:41:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Acquiring lock "cinder-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "cinder-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Acquiring lock "cinder-quobyte-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "cinder-quobyte-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:01 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ab9e27-e32d-4814-942f-26bd216790fd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:01 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c Sep 11 21:41:02 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:02 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c" returned: 0 in 0.354s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:02 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c Sep 11 21:41:02 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:02 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "cinder-quobyte-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c" released by "delete_volume" :: held 0.636s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Created reservations ['4e778ae5-720f-409f-b15b-1f6731e57c7e', '2d4b6e77-c121-4650-8ea2-066bdce314c6', '29407a23-9efd-4580-a4de-7125c86cb6b1', 'da37673c-2dba-4bf7-98a4-36c8a18c77a6'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:02 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:41:02 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:02 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.236s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:41:02 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Deleted volume successfully. Sep 11 21:41:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-edb140c7-d695-4e32-8cfa-d099fbd81f3f tempest-TestServerVolumeAttachScenarioOldVersion-1761199949 None] Lock "cinder-c2e0dc3f-27a5-4bf1-be96-0b9fcedc2d4c-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:12 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=13,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:41:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:41:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:15 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:41:15 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:16 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.312s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:41:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:41:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:41:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (7deab8d1-d456-4269-9acd-74bf0a50f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401f69eb-0fb6-4677-a339-d44a73c8cd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401f69eb-0fb6-4677-a339-d44a73c8cd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-600208168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdeb3a63-148b-4fbc-835c-ef38de61be5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:17Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676f0ded-185f-446a-b21e-3526d57094bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676f0ded-185f-446a-b21e-3526d57094bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92508008-c0d1-4faf-b8c1-e1573de9fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92508008-c0d1-4faf-b8c1-e1573de9fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdeb3a63-148b-4fbc-835c-ef38de61be5e', 'volume_name': 'volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9eb69a-ccbd-425c-a5af-2185e3ec2b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9eb69a-ccbd-425c-a5af-2185e3ec2b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef84a61e-175d-4338-aa48-9ba597db5f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:17 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume fdeb3a63-148b-4fbc-835c-ef38de61be5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e', 'volume_size': 1} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-600208168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdeb3a63-148b-4fbc-835c-ef38de61be5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:17Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Creating volume fdeb3a63-148b-4fbc-835c-ef38de61be5e {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:41:17 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:17 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e 1073741824 Sep 11 21:41:17 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:17 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e 1073741824" returned: 0 in 0.407s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:17 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e Sep 11 21:41:17 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:18 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e" returned: 0 in 0.235s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef84a61e-175d-4338-aa48-9ba597db5f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36b0288-8b4b-4068-993a-d880482c33fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:18 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e (fdeb3a63-148b-4fbc-835c-ef38de61be5e): created successfully Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36b0288-8b4b-4068-993a-d880482c33fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (7deab8d1-d456-4269-9acd-74bf0a50f058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:18 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a5e8e8be-c87f-42b3-a044-5173edd2a150 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created volume successfully. Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Creating offline snapshot d428bab5-51ca-4468-9ff1-f63b57c426a8 of volume fdeb3a63-148b-4fbc-835c-ef38de61be5e {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf00c68-aa63-411f-adf3-7ad74090c69e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:18 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e Sep 11 21:41:18 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:18 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e" returned: 0 in 0.336s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:18 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 1G Sep 11 21:41:18 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:19 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 1G" returned: 0 in 0.362s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:19 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 Sep 11 21:41:19 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:19 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8" returned: 0 in 0.269s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:19 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 is being set with open permissions: ugo+rw Sep 11 21:41:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:19 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 Sep 11 21:41:19 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:19 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8" returned: 0 in 0.230s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:19 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.info Sep 11 21:41:19 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:19 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.info" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:19 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.info is being set with open permissions: ugo+rw Sep 11 21:41:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:19 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.info Sep 11 21:41:19 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:20 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.info" returned: 0 in 0.246s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.766s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:20 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b4de68c4-560b-4b51-b634-4dc45e85f3cb tempest-CreateVolumesFromSnapshotTest-1919330962 None] Create snapshot completed successfully Sep 11 21:41:20 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (a5abd557-95b5-4149-8ad8-ea99e0b60788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7f1a13-0223-44c1-8df5-9b3f1f0dd3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7f1a13-0223-44c1-8df5-9b3f1f0dd3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374341715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45c01d3-fa33-439d-a61f-9daf33c7ed21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:21Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceb840c-fa90-4b42-a00a-5f08924b7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceb840c-fa90-4b42-a00a-5f08924b7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc498e2d-8705-473a-a10e-ab888dc31dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc498e2d-8705-473a-a10e-ab888dc31dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a45c01d3-fa33-439d-a61f-9daf33c7ed21', 'volume_name': 'volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafc4262-2b0d-444f-a7f3-ff297c1967be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafc4262-2b0d-444f-a7f3-ff297c1967be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36803519-5f45-4f8b-bc12-68b77abb5f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume a45c01d3-fa33-439d-a61f-9daf33c7ed21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21', 'volume_size': 1} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374341715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45c01d3-fa33-439d-a61f-9daf33c7ed21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:21Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Creating volume a45c01d3-fa33-439d-a61f-9daf33c7ed21 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:41:21 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:21 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 1073741824 Sep 11 21:41:21 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (7b7e522b-b5ee-4da8-822e-bae916113e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca672897-51db-4202-9bcb-6dbe406b8108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca672897-51db-4202-9bcb-6dbe406b8108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295167260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7276ea59-8760-4f41-bb4f-7426e3e5811e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:21Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4059b078-8250-4b96-9b08-995228edabf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4059b078-8250-4b96-9b08-995228edabf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f097bea-0525-419c-91ed-a63750ed7d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f097bea-0525-419c-91ed-a63750ed7d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7276ea59-8760-4f41-bb4f-7426e3e5811e', 'volume_name': 'volume-7276ea59-8760-4f41-bb4f-7426e3e5811e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125b10a8-74c9-47be-99ca-74bab900a38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125b10a8-74c9-47be-99ca-74bab900a38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7c7c81-82ce-48ce-9edd-732b5c0e36d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume 7276ea59-8760-4f41-bb4f-7426e3e5811e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7276ea59-8760-4f41-bb4f-7426e3e5811e', 'volume_size': 1} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 1073741824" returned: 0 in 0.483s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:21 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 Sep 11 21:41:21 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (2dce2111-31f6-4a0c-b483-b98784f0b5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330ef905-6df3-4575-a6eb-ff4a3f527ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330ef905-6df3-4575-a6eb-ff4a3f527ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1845942847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d0ed8d-db04-4108-8eb1-2a9e00b6237d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:22Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633fa44e-6185-4be7-8817-6d1a128a1c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633fa44e-6185-4be7-8817-6d1a128a1c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df000dd8-61ae-4d01-91bb-fd8af9d71d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df000dd8-61ae-4d01-91bb-fd8af9d71d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d0ed8d-db04-4108-8eb1-2a9e00b6237d', 'volume_name': 'volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82084897-7efe-4d88-9fea-d73ff3cd2288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82084897-7efe-4d88-9fea-d73ff3cd2288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c8b230-28c8-4490-be3a-79351a2fa575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume 39d0ed8d-db04-4108-8eb1-2a9e00b6237d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d', 'volume_size': 1} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21" returned: 0 in 0.285s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295167260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7276ea59-8760-4f41-bb4f-7426e3e5811e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:21Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Creating volume 7276ea59-8760-4f41-bb4f-7426e3e5811e {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:41:21 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36803519-5f45-4f8b-bc12-68b77abb5f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323fcbe0-2ead-4c72-89b2-891690a27717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:21 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e 1073741824 Sep 11 21:41:21 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:21 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 (a45c01d3-fa33-439d-a61f-9daf33c7ed21): created successfully Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323fcbe0-2ead-4c72-89b2-891690a27717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (a5abd557-95b5-4149-8ad8-ea99e0b60788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cb70d90b-4a5d-463c-ae85-4117e5e64462 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created volume successfully. Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (8c2fbe76-e7b9-4f23-971a-4bb985b5ab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36a885e-b7cd-4923-9eb5-a61eaeb63e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36a885e-b7cd-4923-9eb5-a61eaeb63e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162476344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f9863c-fffd-4797-ba92-6662cd74bb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:22Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f019683-9661-44fa-821c-9cb79dec1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f019683-9661-44fa-821c-9cb79dec1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0cdc3ee-123d-47cd-8797-91e1eb878c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0cdc3ee-123d-47cd-8797-91e1eb878c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f9863c-fffd-4797-ba92-6662cd74bb49', 'volume_name': 'volume-35f9863c-fffd-4797-ba92-6662cd74bb49', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c0f39a-a0bd-48ba-a98f-add171191d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c0f39a-a0bd-48ba-a98f-add171191d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b29d9d-8b48-4f8b-8ca1-ae48ef76b295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume 35f9863c-fffd-4797-ba92-6662cd74bb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f9863c-fffd-4797-ba92-6662cd74bb49', 'volume_size': 1} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:22 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e 1073741824" returned: 0 in 0.480s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:22 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e Sep 11 21:41:22 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (0f35114a-5ff1-45e2-8756-2d562c1e33d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d54c6b3-169e-4fc8-aeca-f20f621ac0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d54c6b3-169e-4fc8-aeca-f20f621ac0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213883328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b654e727-861f-4f23-a3a8-5faa4bff3ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:22Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f04c092-75e6-44af-baee-1eec6c5db45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f04c092-75e6-44af-baee-1eec6c5db45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10d872e-d4a8-42c8-8bf8-c1c479720e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10d872e-d4a8-42c8-8bf8-c1c479720e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b654e727-861f-4f23-a3a8-5faa4bff3ebb', 'volume_name': 'volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94216fad-0624-4197-a9f2-f24e1f39ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94216fad-0624-4197-a9f2-f24e1f39ab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc115d77-9b89-43c9-8425-d6f19a13bf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume b654e727-861f-4f23-a3a8-5faa4bff3ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb', 'volume_size': 1} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:22 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e" returned: 0 in 0.249s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.787s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1845942847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d0ed8d-db04-4108-8eb1-2a9e00b6237d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:22Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Creating volume 39d0ed8d-db04-4108-8eb1-2a9e00b6237d {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:41:22 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:22 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d 1073741824 Sep 11 21:41:22 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7c7c81-82ce-48ce-9edd-732b5c0e36d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7276ea59-8760-4f41-bb4f-7426e3e5811e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10f8ccb-edff-44f2-b03c-85106016fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:22 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume volume-7276ea59-8760-4f41-bb4f-7426e3e5811e (7276ea59-8760-4f41-bb4f-7426e3e5811e): created successfully Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10f8ccb-edff-44f2-b03c-85106016fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (7b7e522b-b5ee-4da8-822e-bae916113e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3a9122d9-c2c9-472e-a7be-8dd7afeaf899 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created volume successfully. Sep 11 21:41:23 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d 1073741824" returned: 0 in 0.406s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:23 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d Sep 11 21:41:23 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:23 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d" returned: 0 in 0.233s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.087s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162476344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f9863c-fffd-4797-ba92-6662cd74bb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:22Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Creating volume 35f9863c-fffd-4797-ba92-6662cd74bb49 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:41:23 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c8b230-28c8-4490-be3a-79351a2fa575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:23 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49 1073741824 Sep 11 21:41:23 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00622b97-4861-4f0d-b398-299077448359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:23 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d (39d0ed8d-db04-4108-8eb1-2a9e00b6237d): created successfully Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00622b97-4861-4f0d-b398-299077448359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (2dce2111-31f6-4a0c-b483-b98784f0b5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:23 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-bc2a3748-03ef-4a96-b782-e60bdf78a604 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created volume successfully. Sep 11 21:41:23 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49 1073741824" returned: 0 in 0.411s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:23 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49 Sep 11 21:41:23 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:24 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49" returned: 0 in 0.233s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213883328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b654e727-861f-4f23-a3a8-5faa4bff3ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a00009761a4428692f6664b2f503664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:22Z,use_quota=True,user_id='c8add28064a440c8a049a996b4c4285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Creating volume b654e727-861f-4f23-a3a8-5faa4bff3ebb {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:41:24 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b29d9d-8b48-4f8b-8ca1-ae48ef76b295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f9863c-fffd-4797-ba92-6662cd74bb49', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:24 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb 1073741824 Sep 11 21:41:24 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d478c693-5f73-47ef-b8d9-231ab31930bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:24 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume volume-35f9863c-fffd-4797-ba92-6662cd74bb49 (35f9863c-fffd-4797-ba92-6662cd74bb49): created successfully Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d478c693-5f73-47ef-b8d9-231ab31930bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (8c2fbe76-e7b9-4f23-971a-4bb985b5ab38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:24 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d1a71f2e-e757-4d3e-a301-7c263fc5806c tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created volume successfully. Sep 11 21:41:24 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb 1073741824" returned: 0 in 0.397s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:24 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb Sep 11 21:41:24 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:24 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb" returned: 0 in 0.246s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc115d77-9b89-43c9-8425-d6f19a13bf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff730ac-467b-45e7-aeca-535272e4b17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:24 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Volume volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb (b654e727-861f-4f23-a3a8-5faa4bff3ebb): created successfully Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff730ac-467b-45e7-aeca-535272e4b17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Flow 'volume_create_manager' (0f35114a-5ff1-45e2-8756-2d562c1e33d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:24 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-75f0ccdf-8463-4c99-a584-73c64191146f tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created volume successfully. Sep 11 21:41:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-b654e727-861f-4f23-a3a8-5faa4bff3ebb-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-b654e727-861f-4f23-a3a8-5faa4bff3ebb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-quobyte-b654e727-861f-4f23-a3a8-5faa4bff3ebb" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-b654e727-861f-4f23-a3a8-5faa4bff3ebb" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:25 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[61788a5c-28b8-45c2-8e93-a92406efd7fc]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:26 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb Sep 11 21:41:26 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:26 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb" returned: 0 in 0.352s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:26 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb Sep 11 21:41:26 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:26 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b654e727-861f-4f23-a3a8-5faa4bff3ebb" returned: 0 in 0.251s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-b654e727-861f-4f23-a3a8-5faa4bff3ebb" released by "delete_volume" :: held 0.650s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created reservations ['2ca112b9-663e-4ac3-b438-bd4895eef0a9', '7ff62481-eab8-42b7-8021-89a27d858966', '180ef4c3-bfd1-4fbd-8400-ac5b0409f725', '627ffe26-170f-4b22-b779-13702f587363'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:26 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:41:26 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:26 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.246s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:41:27 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Deleted volume successfully. Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-73d02810-0ed0-4ce9-a23d-d137dcbef669 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-b654e727-861f-4f23-a3a8-5faa4bff3ebb-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-35f9863c-fffd-4797-ba92-6662cd74bb49-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-35f9863c-fffd-4797-ba92-6662cd74bb49-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-quobyte-35f9863c-fffd-4797-ba92-6662cd74bb49" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-35f9863c-fffd-4797-ba92-6662cd74bb49" acquired by "delete_volume" :: waited 0.013s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5069693-0ea4-41d6-a508-f6820898b52a]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:27 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49 Sep 11 21:41:27 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:27 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49" returned: 0 in 0.336s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:27 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49 Sep 11 21:41:27 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:27 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-35f9863c-fffd-4797-ba92-6662cd74bb49" returned: 0 in 0.234s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-35f9863c-fffd-4797-ba92-6662cd74bb49" released by "delete_volume" :: held 0.606s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created reservations ['428c6953-f483-4a43-989b-a5fafa7e7193', 'a6030ea2-eadd-4192-8e4c-fbf955fdd748', 'd0a449c2-ca2a-4b4b-80ef-6e26e88c5b03', '31f98127-a4cb-4105-8d79-6737a6739645'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:27 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:41:27 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:28 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.239s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:41:28 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Deleted volume successfully. Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-98d4405d-c465-40bc-8b3a-cea5581750d1 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-35f9863c-fffd-4797-ba92-6662cd74bb49-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-39d0ed8d-db04-4108-8eb1-2a9e00b6237d-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-39d0ed8d-db04-4108-8eb1-2a9e00b6237d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-quobyte-39d0ed8d-db04-4108-8eb1-2a9e00b6237d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-39d0ed8d-db04-4108-8eb1-2a9e00b6237d" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc335b99-5db9-48cb-abe5-673d59d95a3e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:28 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d Sep 11 21:41:28 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:28 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d" returned: 0 in 0.342s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:28 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d Sep 11 21:41:28 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:28 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-39d0ed8d-db04-4108-8eb1-2a9e00b6237d" returned: 0 in 0.233s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-39d0ed8d-db04-4108-8eb1-2a9e00b6237d" released by "delete_volume" :: held 0.611s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created reservations ['5a2e5207-76be-4875-a7dd-e1f834a7ed83', '12d9f3fb-a453-437d-888d-0ffed16552f1', '1bf6fd24-c6d1-45bd-b415-aeec307d7941', 'da1158ec-663a-4d74-b457-dabbfdf09a9b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:29 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:41:29 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:29 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.228s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:41:29 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Deleted volume successfully. Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ff8df59e-053e-4afb-9fe1-aba818c26f74 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-39d0ed8d-db04-4108-8eb1-2a9e00b6237d-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-7276ea59-8760-4f41-bb4f-7426e3e5811e-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-7276ea59-8760-4f41-bb4f-7426e3e5811e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-quobyte-7276ea59-8760-4f41-bb4f-7426e3e5811e" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-7276ea59-8760-4f41-bb4f-7426e3e5811e" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbf1cd0-1c61-42f3-ae15-6bdd596caf13]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:29 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e Sep 11 21:41:29 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:29 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:29 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e" returned: 0 in 0.337s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:29 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:30 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7276ea59-8760-4f41-bb4f-7426e3e5811e" returned: 0 in 0.264s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-7276ea59-8760-4f41-bb4f-7426e3e5811e" released by "delete_volume" :: held 0.637s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created reservations ['2026c9c3-dbc3-4e37-901d-74c67a69b60e', '82fe00fe-2efb-4966-a60b-e81e87c2e1b2', '3b8a86b8-0e33-4520-8a9f-d83d7a28031d', '9390d5f7-df6b-4243-bb80-7df8d065218e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:30 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:41:30 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:30 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.225s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:41:30 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Deleted volume successfully. Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-81a2a8b7-fa71-48e1-9100-c59228195075 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-7276ea59-8760-4f41-bb4f-7426e3e5811e-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-a45c01d3-fa33-439d-a61f-9daf33c7ed21-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-a45c01d3-fa33-439d-a61f-9daf33c7ed21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-quobyte-a45c01d3-fa33-439d-a61f-9daf33c7ed21" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-a45c01d3-fa33-439d-a61f-9daf33c7ed21" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3342b0d-2d46-4fd1-a2c6-041edf734c19]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:30 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 Sep 11 21:41:30 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:30 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21" returned: 0 in 0.379s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:30 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21 Sep 11 21:41:30 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:31 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a45c01d3-fa33-439d-a61f-9daf33c7ed21" returned: 0 in 0.239s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-a45c01d3-fa33-439d-a61f-9daf33c7ed21" released by "delete_volume" :: held 0.656s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created reservations ['a9daa540-64c6-48cf-bf99-efd49e33d7dd', '9b8bdf4d-91f7-40ff-8b53-289fab033314', 'da9a378b-c378-4d5a-9cde-b51694389b38', 'b11582de-e202-4452-89a8-4194cc402fda'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:31 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:41:31 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:31 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.230s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:41:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Deleted volume successfully. Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-31abf291-df08-49ed-996f-71e950968d9e tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-a45c01d3-fa33-439d-a61f-9daf33c7ed21-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-d428bab5-51ca-4468-9ff1-f63b57c426a8-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-d428bab5-51ca-4468-9ff1-f63b57c426a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-quobyte-fdeb3a63-148b-4fbc-835c-ef38de61be5e" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-fdeb3a63-148b-4fbc-835c-ef38de61be5e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-quobyte-d428bab5-51ca-4468-9ff1-f63b57c426a8" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-d428bab5-51ca-4468-9ff1-f63b57c426a8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Deleting offline snapshot d428bab5-51ca-4468-9ff1-f63b57c426a8 of volume fdeb3a63-148b-4fbc-835c-ef38de61be5e {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] snapshot_file for this snap is: volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a197dd-8a15-4afb-ac7c-9c9fa97a7aad]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:31 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 Sep 11 21:41:31 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:32 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8" returned: 0 in 0.336s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:41:32 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7372652-42b3-4944-a8c8-04f416f1a566]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:32 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e Sep 11 21:41:32 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:32 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e" returned: 0 in 0.333s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:32 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 Sep 11 21:41:32 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:32 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8" returned: 0 in 0.315s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:32 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8 Sep 11 21:41:32 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:32 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e.d428bab5-51ca-4468-9ff1-f63b57c426a8" returned: 0 in 0.244s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-d428bab5-51ca-4468-9ff1-f63b57c426a8" released by "_delete_snapshot" :: held 1.317s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-fdeb3a63-148b-4fbc-835c-ef38de61be5e" released by "delete_snapshot" :: held 1.340s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created reservations ['002a274b-dce1-4842-bf14-df2340e137ef', 'fbe5913b-c79f-444e-8798-12f1a4295212', '49a60b31-e5a5-45ba-b1d3-d90fb8f7ecf7', '9684e572-ac79-42d8-81e0-8c3157085f9a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:41:33 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Delete snapshot completed successfully. Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-43e73b93-5370-4b4e-ba91-57485b16accf tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-d428bab5-51ca-4468-9ff1-f63b57c426a8-delete_snapshot" released by "delete_snapshot" :: held 1.460s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-fdeb3a63-148b-4fbc-835c-ef38de61be5e-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-fdeb3a63-148b-4fbc-835c-ef38de61be5e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "cinder-quobyte-fdeb3a63-148b-4fbc-835c-ef38de61be5e" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-fdeb3a63-148b-4fbc-835c-ef38de61be5e" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece8b0fd-eacd-4e4b-a9ea-7e6c99920266]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:41:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:34 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e Sep 11 21:41:34 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:34 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e" returned: 0 in 0.361s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:34 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e Sep 11 21:41:34 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:34 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fdeb3a63-148b-4fbc-835c-ef38de61be5e" returned: 0 in 0.239s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-quobyte-fdeb3a63-148b-4fbc-835c-ef38de61be5e" released by "delete_volume" :: held 0.659s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Created reservations ['742e3370-0888-4edf-81eb-7f87962bb3dd', '887b4ddc-5dac-4359-834b-716b3a833549', 'da552393-6e6c-46c5-80a5-40253639c9f7', 'a71930d8-17ea-417f-8691-7ee4911b1ca0'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:34 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:41:34 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:34 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.249s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:41:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Deleted volume successfully. Sep 11 21:41:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b63150aa-f703-4482-951b-01b075dc79a3 tempest-CreateVolumesFromSnapshotTest-1919330962 None] Lock "cinder-fdeb3a63-148b-4fbc-835c-ef38de61be5e-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:41:44 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=74,cinder:SELECT=50,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:41:44 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=85,cinder:SELECT=69,cinder:INSERT=20,cinder:DELETE=10 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Flow 'volume_create_manager' (1c97408b-5a6b-4691-8439-be0faba6f8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7b49f7-efa0-414d-8cc6-6fa793fb5fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7b49f7-efa0-414d-8cc6-6fa793fb5fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-333992889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961266ce-6074-4685-93df-61734e2571c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a2728991794885aedcb537d036c522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:59Z,use_quota=True,user_id='5e01b04559ec4f62b7168202d8e22b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ae8525-adfc-43d1-b452-ca7242061804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ae8525-adfc-43d1-b452-ca7242061804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ec5042-3108-4d96-a36f-2b837b9acb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ec5042-3108-4d96-a36f-2b837b9acb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '961266ce-6074-4685-93df-61734e2571c8', 'volume_name': 'volume-961266ce-6074-4685-93df-61734e2571c8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0af293f-008c-4d73-a54f-fec5ea9d695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0af293f-008c-4d73-a54f-fec5ea9d695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c8baba-eedc-4e0a-a163-a4fa8509e977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Volume 961266ce-6074-4685-93df-61734e2571c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-961266ce-6074-4685-93df-61734e2571c8', 'volume_size': 1} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-333992889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961266ce-6074-4685-93df-61734e2571c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a2728991794885aedcb537d036c522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:41:59Z,use_quota=True,user_id='5e01b04559ec4f62b7168202d8e22b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Creating volume 961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:41:59 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:59 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 1073741824 Sep 11 21:41:59 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:59 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 1073741824" returned: 0 in 0.407s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:41:59 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 Sep 11 21:41:59 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:41:59 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8" returned: 0 in 0.238s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c8baba-eedc-4e0a-a163-a4fa8509e977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961266ce-6074-4685-93df-61734e2571c8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f86030-7f02-4772-8398-87c695a2d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:41:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Volume volume-961266ce-6074-4685-93df-61734e2571c8 (961266ce-6074-4685-93df-61734e2571c8): created successfully Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f86030-7f02-4772-8398-87c695a2d085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:41:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Flow 'volume_create_manager' (1c97408b-5a6b-4691-8439-be0faba6f8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:41:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-da3720eb-e5e7-4d7b-9933-9ea36c71faa3 tempest-SnapshotDependencyTests-171329706 None] Created volume successfully. Sep 11 21:42:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Creating offline snapshot 93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 of volume 961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:42:00 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[09934082-3505-4794-937c-cf745a27a9c4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:00 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 Sep 11 21:42:00 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:00 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8" returned: 0 in 0.349s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:00 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 1G Sep 11 21:42:00 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:01 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 1G" returned: 0 in 0.385s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961266ce-6074-4685-93df-61734e2571c8 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:01 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961266ce-6074-4685-93df-61734e2571c8 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 Sep 11 21:42:01 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:01 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961266ce-6074-4685-93df-61734e2571c8 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17" returned: 0 in 0.300s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:01 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 is being set with open permissions: ugo+rw Sep 11 21:42:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:01 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 Sep 11 21:42:01 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:01 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17" returned: 0 in 0.266s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:01 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.info Sep 11 21:42:01 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:01 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.info" returned: 0 in 0.246s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:01 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.info is being set with open permissions: ugo+rw Sep 11 21:42:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:02 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.info Sep 11 21:42:02 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:02 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.info" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:02 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a9272e00-eb97-4b73-b638-d31f7be09641 tempest-SnapshotDependencyTests-171329706 None] Create snapshot completed successfully Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Flow 'volume_create_manager' (ea94941f-fbcd-4428-ad1e-8c3ba89bae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a57edaa-919c-4e11-8eb9-34a1718c6e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a57edaa-919c-4e11-8eb9-34a1718c6e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42376f8-9dc3-4577-848b-55ea8eaf82fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a2728991794885aedcb537d036c522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93b83ec2-3b18-4a14-aa9f-d9194d3d9d17,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:03Z,use_quota=True,user_id='5e01b04559ec4f62b7168202d8e22b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092d90c6-ba8a-47a6-8655-d92b5192e7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092d90c6-ba8a-47a6-8655-d92b5192e7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd0ed5e-45d8-45bf-afc8-93ce2beffb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd0ed5e-45d8-45bf-afc8-93ce2beffb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f42376f8-9dc3-4577-848b-55ea8eaf82fe', 'volume_name': 'volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe', 'volume_size': 1, 'snapshot_id': '93b83ec2-3b18-4a14-aa9f-d9194d3d9d17'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d698758-2895-404a-bd97-1ec32e70e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d698758-2895-404a-bd97-1ec32e70e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79c8846-9d97-479f-8c1c-816af2b2a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:03 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Volume f42376f8-9dc3-4577-848b-55ea8eaf82fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe', 'volume_size': 1, 'snapshot_id': '93b83ec2-3b18-4a14-aa9f-d9194d3d9d17'} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "cinder-quobyte-93b83ec2-3b18-4a14-aa9f-d9194d3d9d17-f42376f8-9dc3-4577-848b-55ea8eaf82fe" by "_create_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-93b83ec2-3b18-4a14-aa9f-d9194d3d9d17-f42376f8-9dc3-4577-848b-55ea8eaf82fe" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Creating volume f42376f8-9dc3-4577-848b-55ea8eaf82fe from snapshot 93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 {{(pid=87423) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "cinder-quobyte-f42376f8-9dc3-4577-848b-55ea8eaf82fe" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-f42376f8-9dc3-4577-848b-55ea8eaf82fe" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] snapshot: 93b83ec2-3b18-4a14-aa9f-d9194d3d9d17, volume: f42376f8-9dc3-4577-848b-55ea8eaf82fe, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3045da62-fb5a-43d6-a625-593486dfe14b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:03 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 Sep 11 21:42:03 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:03 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17" returned: 0 in 0.369s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961266ce-6074-4685-93df-61734e2571c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d106c59b-4e97-4a22-9b1a-401e6ba76856]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:03 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 Sep 11 21:42:03 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:03 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8" returned: 0 in 0.355s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:42:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:04 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe Sep 11 21:42:04 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:07 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe" returned: 0 in 3.940s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:07 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8, size 1024.00 MB, duration 3.94 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:42:07 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Converted 1024.00 MB image at 259.81 MB/s Sep 11 21:42:07 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe is being set with open permissions: ugo+rw Sep 11 21:42:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:07 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe Sep 11 21:42:07 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:08 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe" returned: 0 in 0.237s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-f42376f8-9dc3-4577-848b-55ea8eaf82fe" released by "_copy_volume_from_snapshot" :: held 4.974s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-93b83ec2-3b18-4a14-aa9f-d9194d3d9d17-f42376f8-9dc3-4577-848b-55ea8eaf82fe" released by "_create_volume_from_snapshot" :: held 5.034s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.049s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79c8846-9d97-479f-8c1c-816af2b2a97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe', 'volume_size': 1, 'snapshot_id': '93b83ec2-3b18-4a14-aa9f-d9194d3d9d17'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2c9b2f-22e8-45bd-812d-a3d25671aa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:08 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Volume volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe (f42376f8-9dc3-4577-848b-55ea8eaf82fe): created successfully Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2c9b2f-22e8-45bd-812d-a3d25671aa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Flow 'volume_create_manager' (ea94941f-fbcd-4428-ad1e-8c3ba89bae90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:08 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b9e97bd8-8b7a-4f48-8230-fed15ec997c9 tempest-SnapshotDependencyTests-171329706 None] Created volume successfully. Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "cinder-93b83ec2-3b18-4a14-aa9f-d9194d3d9d17-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-93b83ec2-3b18-4a14-aa9f-d9194d3d9d17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "cinder-quobyte-961266ce-6074-4685-93df-61734e2571c8" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-961266ce-6074-4685-93df-61734e2571c8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "cinder-quobyte-93b83ec2-3b18-4a14-aa9f-d9194d3d9d17" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-93b83ec2-3b18-4a14-aa9f-d9194d3d9d17" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Deleting offline snapshot 93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 of volume 961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] snapshot_file for this snap is: volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f08fe-438a-4f15-aed3-85b5a9a1b0b3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:08 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 Sep 11 21:42:08 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:08 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17" returned: 0 in 0.339s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961266ce-6074-4685-93df-61734e2571c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:42:09 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03987bf-20e6-40d9-9360-bfbb0b65ca08]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:09 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 Sep 11 21:42:09 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:09 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8" returned: 0 in 0.515s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:09 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 Sep 11 21:42:09 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:09 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17" returned: 0 in 0.326s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:09 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17 Sep 11 21:42:09 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:10 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8.93b83ec2-3b18-4a14-aa9f-d9194d3d9d17" returned: 0 in 0.242s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-93b83ec2-3b18-4a14-aa9f-d9194d3d9d17" released by "_delete_snapshot" :: held 1.513s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-961266ce-6074-4685-93df-61734e2571c8" released by "delete_snapshot" :: held 1.533s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Created reservations ['a31ee373-a716-4dba-9349-387c166b2350', '0aaf9993-214a-4573-9f75-fd7bd997c99e', '0ee99cf0-172a-4f53-9cb1-c4b72b26bc7d', '4859c6b8-fc35-4ccb-a838-29c8c890d08e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:10 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Delete snapshot completed successfully. Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-795b09ca-8e2c-4d66-b35d-f1d72e030459 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-93b83ec2-3b18-4a14-aa9f-d9194d3d9d17-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "cinder-961266ce-6074-4685-93df-61734e2571c8-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-961266ce-6074-4685-93df-61734e2571c8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "cinder-quobyte-961266ce-6074-4685-93df-61734e2571c8" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-961266ce-6074-4685-93df-61734e2571c8" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8982bd-0e7d-4037-93d9-545b03f9bcac]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:10 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 Sep 11 21:42:10 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:11 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8" returned: 0 in 0.339s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:11 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8 Sep 11 21:42:11 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:11 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-961266ce-6074-4685-93df-61734e2571c8" returned: 0 in 0.225s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-961266ce-6074-4685-93df-61734e2571c8" released by "delete_volume" :: held 0.616s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Created reservations ['65b72169-425a-4d76-894f-4c7727c580fa', 'd0fab4f7-a15d-4ef5-81d7-dcc28642c11b', '71599443-6b58-4327-96dd-f5edce037fe8', '138ec356-411c-4d46-8037-465fee2c7b6e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:11 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:11 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:11 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.237s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Deleted volume successfully. Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1dec3885-0957-435a-bb21-07fdb7a26b26 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-961266ce-6074-4685-93df-61734e2571c8-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "cinder-f42376f8-9dc3-4577-848b-55ea8eaf82fe-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-f42376f8-9dc3-4577-848b-55ea8eaf82fe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "cinder-quobyte-f42376f8-9dc3-4577-848b-55ea8eaf82fe" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-f42376f8-9dc3-4577-848b-55ea8eaf82fe" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04badea-1c7d-4db3-891c-423180c2e9e5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:12 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe Sep 11 21:42:12 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:12 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe" returned: 0 in 0.346s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:12 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe Sep 11 21:42:12 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:12 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f42376f8-9dc3-4577-848b-55ea8eaf82fe" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-quobyte-f42376f8-9dc3-4577-848b-55ea8eaf82fe" released by "delete_volume" :: held 0.623s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Created reservations ['4105690b-7476-4583-ab9f-66092458cdff', 'bb660405-628c-4486-8856-285536019a86', 'bc435542-0ee3-4b25-a056-790dfb02a1da', '39453dab-8fe3-4d37-9a33-a9e29d11855c'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:12 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:12 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:12 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.228s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Deleted volume successfully. Sep 11 21:42:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7560681-a4c3-49af-a614-05409eecca02 tempest-SnapshotDependencyTests-171329706 None] Lock "cinder-f42376f8-9dc3-4577-848b-55ea8eaf82fe-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:42:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:15 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:15 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:16 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.261s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:42:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:42:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:42:22 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=29,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:42:22 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=33,cinder:SELECT=20,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (add351c9-659a-415b-b7a2-9a5664ddf2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a70650-16f6-40f7-9246-6cc9bb6f8c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a70650-16f6-40f7-9246-6cc9bb6f8c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1984338915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0338d1b-be30-4da6-8252-8e7c50f3ba1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:33Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1706959-9e9b-451f-b9c1-2cd33cd17203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1706959-9e9b-451f-b9c1-2cd33cd17203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43066eaf-d50b-4f49-8c26-a44c470559da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43066eaf-d50b-4f49-8c26-a44c470559da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0338d1b-be30-4da6-8252-8e7c50f3ba1c', 'volume_name': 'volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9483861c-ae19-4425-8d75-bc0675b89826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9483861c-ae19-4425-8d75-bc0675b89826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a84ab0-22ee-498a-82bd-e2df23a36aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:32 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume b0338d1b-be30-4da6-8252-8e7c50f3ba1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c', 'volume_size': 1} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1984338915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0338d1b-be30-4da6-8252-8e7c50f3ba1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:33Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Creating volume b0338d1b-be30-4da6-8252-8e7c50f3ba1c {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:32 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:32 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c 1073741824 Sep 11 21:42:32 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:32 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (b0723339-206f-4e5f-bebe-b018eaf810ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c39619-7ab3-4275-80d7-9e49def759e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c39619-7ab3-4275-80d7-9e49def759e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106919130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be5375c-9858-46cb-9457-6996d26487b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:33Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad12f4b-a63e-44fa-bd7d-601a4dcaec2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad12f4b-a63e-44fa-bd7d-601a4dcaec2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d467f35-f9fc-4158-b731-5d2d2f77ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d467f35-f9fc-4158-b731-5d2d2f77ba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be5375c-9858-46cb-9457-6996d26487b1', 'volume_name': 'volume-5be5375c-9858-46cb-9457-6996d26487b1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76aec4da-a62a-42e7-b21e-96d4735f9ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76aec4da-a62a-42e7-b21e-96d4735f9ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721f3e60-686f-452b-8d21-aa5d4964b0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume 5be5375c-9858-46cb-9457-6996d26487b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be5375c-9858-46cb-9457-6996d26487b1', 'volume_size': 1} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Flow 'volume_create_manager' (fe75b22d-7f5c-4d96-a75f-774ce96c9963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a412c7bc-6f63-4128-94ac-d3fafe4697d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a412c7bc-6f63-4128-94ac-d3fafe4697d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-599523581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27715e8-1be4-4989-b9ae-48d766104a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c81710a5d184f2ab2366b7a7102c98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:33Z,use_quota=True,user_id='7442302c35124c4287efc48f91b26c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f84b3e-b73c-4b94-bb38-90613c4f91ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f84b3e-b73c-4b94-bb38-90613c4f91ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f1afdc-17b3-41f4-883d-46688fb94d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f1afdc-17b3-41f4-883d-46688fb94d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f27715e8-1be4-4989-b9ae-48d766104a24', 'volume_name': 'volume-f27715e8-1be4-4989-b9ae-48d766104a24', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4e1130-4b48-4137-89cc-76aed99eabee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4e1130-4b48-4137-89cc-76aed99eabee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdeb8454-8d66-4bea-beb7-9115a7bf88db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Volume f27715e8-1be4-4989-b9ae-48d766104a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f27715e8-1be4-4989-b9ae-48d766104a24', 'volume_size': 1} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:33 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c 1073741824" returned: 0 in 0.596s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:33 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c Sep 11 21:42:33 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:33 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" returned: 0 in 0.248s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106919130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be5375c-9858-46cb-9457-6996d26487b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:33Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Creating volume 5be5375c-9858-46cb-9457-6996d26487b1 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:33 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a84ab0-22ee-498a-82bd-e2df23a36aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1 1073741824 Sep 11 21:42:33 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06ec04c-d734-43a2-a836-006d42bd3d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:33 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c (b0338d1b-be30-4da6-8252-8e7c50f3ba1c): created successfully Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06ec04c-d734-43a2-a836-006d42bd3d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (add351c9-659a-415b-b7a2-9a5664ddf2a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:33 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cdf18b57-5120-42ad-9c67-5b8b77601a5b tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created volume successfully. Sep 11 21:42:34 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1 1073741824" returned: 0 in 0.487s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:34 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1 Sep 11 21:42:34 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:34 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1" returned: 0 in 0.275s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-599523581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27715e8-1be4-4989-b9ae-48d766104a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c81710a5d184f2ab2366b7a7102c98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:33Z,use_quota=True,user_id='7442302c35124c4287efc48f91b26c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Creating volume f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:34 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:34 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 1073741824 Sep 11 21:42:34 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721f3e60-686f-452b-8d21-aa5d4964b0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be5375c-9858-46cb-9457-6996d26487b1', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95c5cf9-7658-4d59-b431-eeb1dffbf1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:34 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume volume-5be5375c-9858-46cb-9457-6996d26487b1 (5be5375c-9858-46cb-9457-6996d26487b1): created successfully Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95c5cf9-7658-4d59-b431-eeb1dffbf1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (b0723339-206f-4e5f-bebe-b018eaf810ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-87c50157-0de6-4821-b73e-f3f149eecf8b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created volume successfully. Sep 11 21:42:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:35 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 1073741824" returned: 0 in 0.514s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:35 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 Sep 11 21:42:35 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:35 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24" returned: 0 in 0.258s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.464s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdeb8454-8d66-4bea-beb7-9115a7bf88db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f27715e8-1be4-4989-b9ae-48d766104a24', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bd30d2-138c-41b0-9f67-d23f54d8ba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Creating offline snapshot eaf1b033-4359-4387-be05-c924e972264e of volume b0338d1b-be30-4da6-8252-8e7c50f3ba1c {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:42:35 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Volume volume-f27715e8-1be4-4989-b9ae-48d766104a24 (f27715e8-1be4-4989-b9ae-48d766104a24): created successfully Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bd30d2-138c-41b0-9f67-d23f54d8ba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Flow 'volume_create_manager' (fe75b22d-7f5c-4d96-a75f-774ce96c9963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4d5774-3941-4d33-86c6-6bcfdb1a0fd8]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:35 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8618df02-736d-4b03-814b-98608d03d917 tempest-VolumeDependencyTests-1589991020 None] Created volume successfully. Sep 11 21:42:35 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c Sep 11 21:42:35 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:35 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" returned: 0 in 0.401s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:35 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e 1G Sep 11 21:42:35 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:36 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e 1G" returned: 0 in 0.494s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:36 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e Sep 11 21:42:36 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (67819b95-9dda-4dda-8d61-746dec265941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dc7bb0-0819-4e52-a6ce-adb85080527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dc7bb0-0819-4e52-a6ce-adb85080527f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559859941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f2c26a-c2cf-405c-8b38-41abd92ea755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:36Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04f1b94-2835-4090-b33b-f5498d476438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04f1b94-2835-4090-b33b-f5498d476438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a2f89e-7a54-4b6d-af46-79909c88e269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a2f89e-7a54-4b6d-af46-79909c88e269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f2c26a-c2cf-405c-8b38-41abd92ea755', 'volume_name': 'volume-71f2c26a-c2cf-405c-8b38-41abd92ea755', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234235e2-b2ef-4b90-9759-f7e453c38b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234235e2-b2ef-4b90-9759-f7e453c38b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a127e20-c884-41e4-b4b2-a3038800cb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:36 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume 71f2c26a-c2cf-405c-8b38-41abd92ea755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f2c26a-c2cf-405c-8b38-41abd92ea755', 'volume_size': 1} Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:36 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e" returned: 0 in 0.361s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:36 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e is being set with open permissions: ugo+rw Sep 11 21:42:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:36 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e Sep 11 21:42:36 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:37 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e" returned: 0 in 0.292s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:37 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.info Sep 11 21:42:37 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Flow 'volume_create_manager' (23537379-1875-4a7e-be09-c01cc5eba5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec1e002-a1f8-40a9-822a-48f834c68ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec1e002-a1f8-40a9-822a-48f834c68ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1d1f018e20417eafa6e5991f7e2eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:37Z,use_quota=True,user_id='a0603d9ac1d545139f6b06a6a1eb846d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(866dba44-6917-4bf4-9d6a-98c3d0c1b2ec),volume_type_id=866dba44-6917-4bf4-9d6a-98c3d0c1b2ec)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb820f9-b59c-4622-a8af-44e4d98ece86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb820f9-b59c-4622-a8af-44e4d98ece86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0ace36-ea79-485d-8018-228534fa7960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:37 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.info" returned: 0 in 0.359s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:37 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.info is being set with open permissions: ugo+rw Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:37 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.info Sep 11 21:42:37 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0ace36-ea79-485d-8018-228534fa7960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae', 'volume_name': 'volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae', 'volume_size': 1, 'image_id': '1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5491142dca46c8df9401b58a330e8e5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe1d1f018e20417eafa6e5991f7e2eef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '194988e65569ed03bbfc58d58983e6817b25997c6c76e3f53791e01bb03b707c0d599b1a6727c57d81e6c54cf29497a23977fd72b3361afd2163334027baa156', 'id': '1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'created_at': datetime.datetime(2026, 9, 11, 19, 42, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 42, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed22d45-f6bc-4b5e-9323-d50e93ac7b23/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c9d839-23b9-47ce-825d-2e6c5f23d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c9d839-23b9-47ce-825d-2e6c5f23d763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a9e131-60ed-4524-8cb4-98c5c68bf4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Volume b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae', 'volume_size': 1, 'image_id': '1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5491142dca46c8df9401b58a330e8e5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe1d1f018e20417eafa6e5991f7e2eef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '194988e65569ed03bbfc58d58983e6817b25997c6c76e3f53791e01bb03b707c0d599b1a6727c57d81e6c54cf29497a23977fd72b3361afd2163334027baa156', 'id': '1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'created_at': datetime.datetime(2026, 9, 11, 19, 42, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 42, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed22d45-f6bc-4b5e-9323-d50e93ac7b23/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Trying to clone b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae from image 1ed22d45-f6bc-4b5e-9323-d50e93ac7b23 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:42:37 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (1ddf6bfa-b478-44d3-8053-e12e42374ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158e9d69-13ef-4a26-8ece-a9d47c8367dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.info" returned: 0 in 0.411s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559859941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f2c26a-c2cf-405c-8b38-41abd92ea755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:36Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Creating volume 71f2c26a-c2cf-405c-8b38-41abd92ea755 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:37 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158e9d69-13ef-4a26-8ece-a9d47c8367dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-612402922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2793044-5253-47c2-b6dd-de54618bdddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:38Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:37 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 1073741824 Sep 11 21:42:37 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7547a8b3-bddd-45fb-ac9c-eab69bb59c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7547a8b3-bddd-45fb-ac9c-eab69bb59c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e8d84a-292d-4ebc-897a-6467f34f1742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e8d84a-292d-4ebc-897a-6467f34f1742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2793044-5253-47c2-b6dd-de54618bdddb', 'volume_name': 'volume-a2793044-5253-47c2-b6dd-de54618bdddb', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace0a57b-375d-4dbc-9674-91bf251cb623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace0a57b-375d-4dbc-9674-91bf251cb623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f009d281-3a09-49a0-a9f5-ed631c450e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:37 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume a2793044-5253-47c2-b6dd-de54618bdddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2793044-5253-47c2-b6dd-de54618bdddb', 'volume_size': 1} Sep 11 21:42:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:42:38 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Image download 0.00 MB at 0.00 MB/s Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (f4e8e473-7bc8-4fc9-a0ec-31bf955a3b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb470bd5-2244-4170-a5dc-797eeb11d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb470bd5-2244-4170-a5dc-797eeb11d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1976087738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106ab8a6-eb44-4181-b412-bf416417af3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:38Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c03fa73-b650-473d-8527-e77aeb4293f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c03fa73-b650-473d-8527-e77aeb4293f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7341471f-4e40-47a7-89bc-98915a91acb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7341471f-4e40-47a7-89bc-98915a91acb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106ab8a6-eb44-4181-b412-bf416417af3b', 'volume_name': 'volume-106ab8a6-eb44-4181-b412-bf416417af3b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a910e9-b38d-4121-b1eb-e7ca2c9bc5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a910e9-b38d-4121-b1eb-e7ca2c9bc5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171c294b-d5ba-4990-a708-10af7a47590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume 106ab8a6-eb44-4181-b412-bf416417af3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106ab8a6-eb44-4181-b412-bf416417af3b', 'volume_size': 1} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (4650e3d1-2aea-4458-ad1c-02826a879367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf277d0-1abe-4447-b58b-2cb3799d7d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8b73933f-d991-48dc-a441-c61533862fe9 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Create snapshot completed successfully Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb07a648-0fab-4111-8b91-3c1f7cc32030]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf277d0-1abe-4447-b58b-2cb3799d7d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441766766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c394c835-85e4-4589-91b6-1111a6a96eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:38Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb39eeb-4478-437f-b92a-cb7ff73dbdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb39eeb-4478-437f-b92a-cb7ff73dbdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73179d93-a4d2-4b11-ba9d-6b3cffde9eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73179d93-a4d2-4b11-ba9d-6b3cffde9eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c394c835-85e4-4589-91b6-1111a6a96eaf', 'volume_name': 'volume-c394c835-85e4-4589-91b6-1111a6a96eaf', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48a9865-6f32-4ae6-bdb1-73427c21d1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48a9865-6f32-4ae6-bdb1-73427c21d1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d99c1fd-023f-4366-9981-34a964a88db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume c394c835-85e4-4589-91b6-1111a6a96eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c394c835-85e4-4589-91b6-1111a6a96eaf', 'volume_size': 1} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (8872aca6-4667-44df-b4fa-467330bab744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ce7b2b-4653-4e8c-9a2a-bdf0852d7d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ce7b2b-4653-4e8c-9a2a-bdf0852d7d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-961580282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bab9d24-9e1b-487b-80b1-1d954eddee5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:38Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD Sep 11 21:42:38 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b07f61-4c1a-443c-9c64-ab3b889cd697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b07f61-4c1a-443c-9c64-ab3b889cd697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae16f98-5a21-48fd-8b22-029515fe6ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae16f98-5a21-48fd-8b22-029515fe6ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bab9d24-9e1b-487b-80b1-1d954eddee5f', 'volume_name': 'volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d113a4d8-7101-45b9-bcc6-03c4eee1ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d113a4d8-7101-45b9-bcc6-03c4eee1ba67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6e1a29-a74e-43df-b174-0ebfaccf97c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume 7bab9d24-9e1b-487b-80b1-1d954eddee5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f', 'volume_size': 1} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:38 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 1073741824" returned: 0 in 0.511s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:38 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 Sep 11 21:42:38 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:38 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:38 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD Sep 11 21:42:38 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:38 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755" returned: 0 in 0.331s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.386s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Creating offline snapshot 50725d86-eb11-4852-a182-445ad8906c16 of volume f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a127e20-c884-41e4-b4b2-a3038800cb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f2c26a-c2cf-405c-8b38-41abd92ea755', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1494dcd7-4bf7-4f98-8621-78b6aca9b8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf573da-b95d-4f5b-8d8e-172283b8a922]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:38 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 (71f2c26a-c2cf-405c-8b38-41abd92ea755): created successfully Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1494dcd7-4bf7-4f98-8621-78b6aca9b8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (67819b95-9dda-4dda-8d61-746dec265941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:38 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (d6b9b85d-358b-4ab3-8cb7-b0d36080302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d86a8e6-ec54-4adb-ba92-74e1e39445e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5c003882-8a3a-4f64-9529-bf7d2958dc17 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created volume successfully. Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD" returned: 1 in 0.453s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:42:38 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Temporary image 1ed22d45-f6bc-4b5e-9323-d50e93ac7b23 is fetched for user a0603d9ac1d545139f6b06a6a1eb846d. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d86a8e6-ec54-4adb-ba92-74e1e39445e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116351379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78b0832-1f66-4fdb-b4db-c42be4c4879d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:39Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cf29f8-860f-4d1a-97ba-6266ae8071e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cf29f8-860f-4d1a-97ba-6266ae8071e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f8141a-e33a-4529-9f27-90bd743bc1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f8141a-e33a-4529-9f27-90bd743bc1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78b0832-1f66-4fdb-b4db-c42be4c4879d', 'volume_name': 'volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 Sep 11 21:42:39 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16204b3-a47f-496d-ab55-66f20f229706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16204b3-a47f-496d-ab55-66f20f229706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cef2d7-dd4c-4c04-bb75-d6967c4f87ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume f78b0832-1f66-4fdb-b4db-c42be4c4879d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d', 'volume_size': 1} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[13afc1fd-0bed-406c-8187-3826cd8c1263]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:39 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD Sep 11 21:42:39 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (426d5876-a324-471a-9ee0-1c5b83d205bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abce03ed-2c48-4d85-86f3-4ad5709250f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abce03ed-2c48-4d85-86f3-4ad5709250f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-107846213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627cbaae-b1b9-4883-b03d-652fd5667da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:39Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb212e83-641b-428a-b7fc-215b4b4d1b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb212e83-641b-428a-b7fc-215b4b4d1b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6594639f-51e8-409a-9fd4-7ca0c8b8860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6594639f-51e8-409a-9fd4-7ca0c8b8860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '627cbaae-b1b9-4883-b03d-652fd5667da4', 'volume_name': 'volume-627cbaae-b1b9-4883-b03d-652fd5667da4', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157511ba-a59c-4be8-b14d-9e058b8db1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157511ba-a59c-4be8-b14d-9e058b8db1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d45e69-7cd7-4364-ba96-8ee5fa53237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume 627cbaae-b1b9-4883-b03d-652fd5667da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-627cbaae-b1b9-4883-b03d-652fd5667da4', 'volume_size': 1} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24" returned: 0 in 0.608s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:39 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 1G Sep 11 21:42:39 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:39 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:39 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD Sep 11 21:42:39 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (61c99588-1071-4647-a4fe-3db1d98783a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c4be27-734c-4e01-ae0d-8e3719363265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c4be27-734c-4e01-ae0d-8e3719363265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-898962269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8b15be-23f6-48ef-9c23-b804e7362b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:40Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af78da3-7af7-4374-949c-bb2c9946fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af78da3-7af7-4374-949c-bb2c9946fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ede63a-a8ac-490d-a61a-08e09183c3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ede63a-a8ac-490d-a61a-08e09183c3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a8b15be-23f6-48ef-9c23-b804e7362b84', 'volume_name': 'volume-6a8b15be-23f6-48ef-9c23-b804e7362b84', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c0cb3c-210b-4ebe-bfee-41d4d946fa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c0cb3c-210b-4ebe-bfee-41d4d946fa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0346037f-d129-4ce2-aa1a-67c3e1ecdd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:39 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume 6a8b15be-23f6-48ef-9c23-b804e7362b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a8b15be-23f6-48ef-9c23-b804e7362b84', 'volume_size': 1} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:39 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:42:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:40 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 1G" returned: 0 in 0.525s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27715e8-1be4-4989-b9ae-48d766104a24 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:40 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27715e8-1be4-4989-b9ae-48d766104a24 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 Sep 11 21:42:40 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (b5c63c64-b5d8-4222-a76c-5604af7d9f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646d2106-9496-4bca-85c1-44b055973e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646d2106-9496-4bca-85c1-44b055973e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963545335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f90049-6a0f-43da-a835-b50903c5d4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:40Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb754da9-fd22-4b7c-b3c1-47164e8b0368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb754da9-fd22-4b7c-b3c1-47164e8b0368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a8518f-96c2-42dd-a90f-7054cab5a1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a8518f-96c2-42dd-a90f-7054cab5a1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f90049-6a0f-43da-a835-b50903c5d4be', 'volume_name': 'volume-45f90049-6a0f-43da-a835-b50903c5d4be', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c85d21-0adc-4982-aa0c-9b908dc5a087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c85d21-0adc-4982-aa0c-9b908dc5a087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56eba10-9028-4f8d-9c27-73f2ba8d7ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume 45f90049-6a0f-43da-a835-b50903c5d4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f90049-6a0f-43da-a835-b50903c5d4be', 'volume_size': 1} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:40 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27715e8-1be4-4989-b9ae-48d766104a24 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16" returned: 0 in 0.314s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:40 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 is being set with open permissions: ugo+rw Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:40 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 Sep 11 21:42:40 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (0ffaa53c-9916-421c-b155-b81366439f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c390fb-10c5-40aa-964b-0e1cb52ffac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c390fb-10c5-40aa-964b-0e1cb52ffac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921171978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac979d5-84f6-4186-84fd-637cecd88ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:41Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be7d1e2-cbce-46ca-b3cc-ea8582724a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be7d1e2-cbce-46ca-b3cc-ea8582724a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26da5d0-ba31-4fa6-9c42-4f687efe4126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26da5d0-ba31-4fa6-9c42-4f687efe4126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac979d5-84f6-4186-84fd-637cecd88ade', 'volume_name': 'volume-8ac979d5-84f6-4186-84fd-637cecd88ade', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:40 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c1e22f-6f2f-4aeb-98fb-6a84e1c0e935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c1e22f-6f2f-4aeb-98fb-6a84e1c0e935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abe97f8-9c7f-4559-a7a1-2c5bb7eaa759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:40 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume 8ac979d5-84f6-4186-84fd-637cecd88ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac979d5-84f6-4186-84fd-637cecd88ade', 'volume_size': 1} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16" returned: 0 in 0.309s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:40 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.info Sep 11 21:42:40 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:40 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.info" returned: 0 in 0.248s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:40 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.info is being set with open permissions: ugo+rw Sep 11 21:42:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:40 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.info Sep 11 21:42:40 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:41 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.info" returned: 0 in 0.236s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.394s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.209s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-612402922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2793044-5253-47c2-b6dd-de54618bdddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:38Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Creating volume a2793044-5253-47c2-b6dd-de54618bdddb {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:41 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:41 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb 1073741824 Sep 11 21:42:41 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-1512952e-75f6-488e-9901-b0aeb43340d3 tempest-VolumeDependencyTests-1589991020 None] Create snapshot completed successfully Sep 11 21:42:41 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb 1073741824" returned: 0 in 0.412s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:41 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb Sep 11 21:42:41 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:41 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb" returned: 0 in 0.232s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.763s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1976087738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106ab8a6-eb44-4181-b412-bf416417af3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:38Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Creating volume 106ab8a6-eb44-4181-b412-bf416417af3b {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:41 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f009d281-3a09-49a0-a9f5-ed631c450e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2793044-5253-47c2-b6dd-de54618bdddb', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:41 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b 1073741824 Sep 11 21:42:41 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14b44e5-b673-4114-9a99-056d4a3f3022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:41 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume volume-a2793044-5253-47c2-b6dd-de54618bdddb (a2793044-5253-47c2-b6dd-de54618bdddb): created successfully Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14b44e5-b673-4114-9a99-056d4a3f3022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (1ddf6bfa-b478-44d3-8053-e12e42374ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8cad9f1c-8a7b-48df-8085-85553163f0c9 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created volume successfully. Sep 11 21:42:42 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b 1073741824" returned: 0 in 0.404s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:42 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b Sep 11 21:42:42 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:42 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b" returned: 0 in 0.256s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.353s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441766766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c394c835-85e4-4589-91b6-1111a6a96eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:38Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Creating volume c394c835-85e4-4589-91b6-1111a6a96eaf {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:42 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171c294b-d5ba-4990-a708-10af7a47590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106ab8a6-eb44-4181-b412-bf416417af3b', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28967e20-dd0a-4135-9071-9f2b1ae1d25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:42 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf 1073741824 Sep 11 21:42:42 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:42 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume volume-106ab8a6-eb44-4181-b412-bf416417af3b (106ab8a6-eb44-4181-b412-bf416417af3b): created successfully Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28967e20-dd0a-4135-9071-9f2b1ae1d25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (f4e8e473-7bc8-4fc9-a0ec-31bf955a3b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:42 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a326c4eb-3af6-4a85-80df-16aa177a401d tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created volume successfully. Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Flow 'volume_create_manager' (641ec6e5-127c-4d69-952f-588ec48c076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebba52a-be3e-4ca5-820b-48ef14d5115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebba52a-be3e-4ca5-820b-48ef14d5115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-573302678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7814617a-c78e-4309-8905-91b03f72fa53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c81710a5d184f2ab2366b7a7102c98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50725d86-eb11-4852-a182-445ad8906c16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:43Z,use_quota=True,user_id='7442302c35124c4287efc48f91b26c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bcc41d-5c6b-4ba7-91e0-17d7e7afe21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bcc41d-5c6b-4ba7-91e0-17d7e7afe21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e6740e-b3dd-4bf4-8113-cdadfd4d4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e6740e-b3dd-4bf4-8113-cdadfd4d4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7814617a-c78e-4309-8905-91b03f72fa53', 'volume_name': 'volume-7814617a-c78e-4309-8905-91b03f72fa53', 'volume_size': 1, 'snapshot_id': '50725d86-eb11-4852-a182-445ad8906c16'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7f40f0-c0ea-4163-9cd4-0b4dc5d2e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7f40f0-c0ea-4163-9cd4-0b4dc5d2e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08dd370-a574-4487-aee3-d8c6a41d5308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:42 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Volume 7814617a-c78e-4309-8905-91b03f72fa53: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7814617a-c78e-4309-8905-91b03f72fa53', 'volume_size': 1, 'snapshot_id': '50725d86-eb11-4852-a182-445ad8906c16'} Sep 11 21:42:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:43 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf 1073741824" returned: 0 in 0.467s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:43 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf Sep 11 21:42:43 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:43 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf" returned: 0 in 0.258s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.013s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-961580282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bab9d24-9e1b-487b-80b1-1d954eddee5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbf7b9e646342c6b0cdf1d747383adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:38Z,use_quota=True,user_id='3e07781e295642b98b0dc06eda3fc996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Creating volume 7bab9d24-9e1b-487b-80b1-1d954eddee5f {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:43 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d99c1fd-023f-4366-9981-34a964a88db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c394c835-85e4-4589-91b6-1111a6a96eaf', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:43 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f 1073741824 Sep 11 21:42:43 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfd5819-c214-41c6-86fc-640f38955370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:43 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume volume-c394c835-85e4-4589-91b6-1111a6a96eaf (c394c835-85e4-4589-91b6-1111a6a96eaf): created successfully Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfd5819-c214-41c6-86fc-640f38955370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (4650e3d1-2aea-4458-ad1c-02826a879367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:43 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d8f6e8c4-ed09-4214-9e82-0b62eba2b760 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created volume successfully. Sep 11 21:42:43 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f 1073741824" returned: 0 in 0.451s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:43 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f Sep 11 21:42:43 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:44 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f" returned: 0 in 0.246s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.025s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116351379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78b0832-1f66-4fdb-b4db-c42be4c4879d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:39Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Creating volume f78b0832-1f66-4fdb-b4db-c42be4c4879d {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:44 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6e1a29-a74e-43df-b174-0ebfaccf97c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:44 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d 1073741824 Sep 11 21:42:44 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148901da-1b02-4845-b740-8db16080809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:44 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Volume volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f (7bab9d24-9e1b-487b-80b1-1d954eddee5f): created successfully Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148901da-1b02-4845-b740-8db16080809a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Flow 'volume_create_manager' (8872aca6-4667-44df-b4fa-467330bab744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-815b9de4-54b0-4189-8d38-a9a8beb371c1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created volume successfully. Sep 11 21:42:44 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d 1073741824" returned: 0 in 0.408s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:44 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d Sep 11 21:42:44 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:44 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d" returned: 0 in 0.256s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.309s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-107846213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627cbaae-b1b9-4883-b03d-652fd5667da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:39Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Creating volume 627cbaae-b1b9-4883-b03d-652fd5667da4 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:44 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cef2d7-dd4c-4c04-bb75-d6967c4f87ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59066c87-0e05-4a92-a978-1657371cf034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:44 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4 1073741824 Sep 11 21:42:44 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:44 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d (f78b0832-1f66-4fdb-b4db-c42be4c4879d): created successfully Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59066c87-0e05-4a92-a978-1657371cf034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (d6b9b85d-358b-4ab3-8cb7-b0d36080302c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3eaa08f7-3118-4519-8df4-f4f8d48372e6 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created volume successfully. Sep 11 21:42:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-7bab9d24-9e1b-487b-80b1-1d954eddee5f-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-7bab9d24-9e1b-487b-80b1-1d954eddee5f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-quobyte-7bab9d24-9e1b-487b-80b1-1d954eddee5f" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-7bab9d24-9e1b-487b-80b1-1d954eddee5f" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5193956-f06d-4b71-b482-db7b770012f4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:45 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f Sep 11 21:42:45 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:45 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4 1073741824" returned: 0 in 0.460s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:45 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4 Sep 11 21:42:45 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:45 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f" returned: 0 in 0.376s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:45 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f Sep 11 21:42:45 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:45 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4" returned: 0 in 0.279s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.702s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-898962269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8b15be-23f6-48ef-9c23-b804e7362b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:40Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Creating volume 6a8b15be-23f6-48ef-9c23-b804e7362b84 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:45 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:45 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 1073741824 Sep 11 21:42:45 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d45e69-7cd7-4364-ba96-8ee5fa53237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627cbaae-b1b9-4883-b03d-652fd5667da4', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663596a9-fd87-4e50-8827-a58157272958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:45 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume volume-627cbaae-b1b9-4883-b03d-652fd5667da4 (627cbaae-b1b9-4883-b03d-652fd5667da4): created successfully Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663596a9-fd87-4e50-8827-a58157272958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (426d5876-a324-471a-9ee0-1c5b83d205bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:45 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-64af4cf2-888f-4ece-9dd6-911cc4b3018c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created volume successfully. Sep 11 21:42:45 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7bab9d24-9e1b-487b-80b1-1d954eddee5f" returned: 0 in 0.290s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-7bab9d24-9e1b-487b-80b1-1d954eddee5f" released by "delete_volume" :: held 0.714s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created reservations ['6342bc6f-1a25-473a-8db5-79aca5d28d9d', '0f5a78f0-055c-47f0-9408-c57db404c6f5', 'e19a0f5d-07d0-4352-b6af-02e496221642', '74764b6d-3f67-480c-89ac-8c1e4bdd6c99'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:45 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:45 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:46 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 1073741824" returned: 0 in 0.466s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:46 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 Sep 11 21:42:46 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-c394c835-85e4-4589-91b6-1111a6a96eaf-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:46 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.261s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Deleted volume successfully. Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-c394c835-85e4-4589-91b6-1111a6a96eaf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-288f54b4-8b1b-4f3b-aec5-06fb8b8e07ed tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-7bab9d24-9e1b-487b-80b1-1d954eddee5f-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-quobyte-c394c835-85e4-4589-91b6-1111a6a96eaf" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-c394c835-85e4-4589-91b6-1111a6a96eaf" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[119b10b6-7e00-47a5-873e-3ce1455d64a8]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:46 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84" returned: 0 in 0.273s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.462s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1d1f018e20417eafa6e5991f7e2eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:37Z,use_quota=True,user_id='a0603d9ac1d545139f6b06a6a1eb846d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(866dba44-6917-4bf4-9d6a-98c3d0c1b2ec),volume_type_id=866dba44-6917-4bf4-9d6a-98c3d0c1b2ec)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Creating volume b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:46 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:46 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf Sep 11 21:42:46 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:46 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae 1073741824 Sep 11 21:42:46 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0346037f-d129-4ce2-aa1a-67c3e1ecdd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a8b15be-23f6-48ef-9c23-b804e7362b84', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1ff8ff-7864-42b5-a514-96befc9b53d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:46 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 (6a8b15be-23f6-48ef-9c23-b804e7362b84): created successfully Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1ff8ff-7864-42b5-a514-96befc9b53d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (61c99588-1071-4647-a4fe-3db1d98783a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0062d8ac-fe5f-48c6-a929-f1d968f73297 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created volume successfully. Sep 11 21:42:46 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf" returned: 0 in 0.392s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:46 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf Sep 11 21:42:46 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:46 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae 1073741824" returned: 0 in 0.424s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:46 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae Sep 11 21:42:46 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:46 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c394c835-85e4-4589-91b6-1111a6a96eaf" returned: 0 in 0.283s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-c394c835-85e4-4589-91b6-1111a6a96eaf" released by "delete_volume" :: held 0.721s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created reservations ['8990b19b-ca10-4817-8c13-409837366fc0', '0ea980bf-7fc7-48dc-9790-02c727fc209e', 'd754e42e-db45-431d-bfb9-2c87d220254c', '1aa31d61-8d1c-4376-a61c-a7c3c11e2d65'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:47 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae" returned: 0 in 0.266s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.844s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963545335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f90049-6a0f-43da-a835-b50903c5d4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:40Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Creating volume 45f90049-6a0f-43da-a835-b50903c5d4be {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:47 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:47 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be 1073741824 Sep 11 21:42:47 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:47 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Attempting download of 1ed22d45-f6bc-4b5e-9323-d50e93ac7b23 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'metadata': {}}])) to volume b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:42:47 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[21479cc3-5b0d-4fcd-801e-78cc0a785cd5]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_szozc9ax {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-106ab8a6-eb44-4181-b412-bf416417af3b-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:47 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_szozc9ax Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-106ab8a6-eb44-4181-b412-bf416417af3b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:47 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-quobyte-106ab8a6-eb44-4181-b412-bf416417af3b" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-106ab8a6-eb44-4181-b412-bf416417af3b" acquired by "delete_volume" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:47 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.332s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:47 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Deleted volume successfully. Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e54b39-8514-4129-a200-012158cbd644]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b15d2b77-5a10-4e92-ade4-d1f5ce0a88a5 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-c394c835-85e4-4589-91b6-1111a6a96eaf-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:47 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b Sep 11 21:42:47 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:47 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be 1073741824" returned: 0 in 0.519s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:47 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_szozc9ax" returned: 0 in 0.438s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_szozc9ax {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:47 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be Sep 11 21:42:47 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:47 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_szozc9ax Sep 11 21:42:47 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:47 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b" returned: 0 in 0.406s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:47 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b Sep 11 21:42:47 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:47 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be" returned: 0 in 0.264s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.335s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921171978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac979d5-84f6-4186-84fd-637cecd88ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ae3ffceb14f3197e64eb735c19b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:42:41Z,use_quota=True,user_id='dd3b7a34576b44f79fbcc0669234130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Creating volume 8ac979d5-84f6-4186-84fd-637cecd88ade {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:47 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:48 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56eba10-9028-4f8d-9c27-73f2ba8d7ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f90049-6a0f-43da-a835-b50903c5d4be', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76003310-4792-4512-96b2-6729dd0b15a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:48 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade 1073741824 Sep 11 21:42:48 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:48 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume volume-45f90049-6a0f-43da-a835-b50903c5d4be (45f90049-6a0f-43da-a835-b50903c5d4be): created successfully Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76003310-4792-4512-96b2-6729dd0b15a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:48 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (b5c63c64-b5d8-4222-a76c-5604af7d9f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_szozc9ax" returned: 1 in 0.375s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_szozc9ax' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[106f4131-b00c-4625-a4f4-fcc506e406a8]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:48 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0c5990d4-2451-477d-a546-51c4c0b8339f tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created volume successfully. Sep 11 21:42:48 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD Sep 11 21:42:48 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:48 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-106ab8a6-eb44-4181-b412-bf416417af3b" returned: 0 in 0.300s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-106ab8a6-eb44-4181-b412-bf416417af3b" released by "delete_volume" :: held 0.763s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created reservations ['b1abc1d2-9133-4136-b0b5-3ba6fd4b38dd', '83fcaa6f-3cf3-4fa8-a1b8-a6d8d3396a57', '6d7d7ac2-b713-457c-b7ba-8b761ca2eae3', 'ef8df1bd-db17-4b41-9bf5-a8c0a8455b51'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:48 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:48 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:48 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:48 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade 1073741824" returned: 0 in 0.563s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-a2793044-5253-47c2-b6dd-de54618bdddb-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:48 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD Sep 11 21:42:48 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-a2793044-5253-47c2-b6dd-de54618bdddb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:48 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade Sep 11 21:42:48 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-quobyte-a2793044-5253-47c2-b6dd-de54618bdddb" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-a2793044-5253-47c2-b6dd-de54618bdddb" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6071fe7-44a2-423c-b84c-e48be8567956]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:48 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.335s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:48 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Deleted volume successfully. Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-386aa419-557c-41cc-99eb-21d27784af42 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-106ab8a6-eb44-4181-b412-bf416417af3b-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:48 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb Sep 11 21:42:48 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:48 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:42:48 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.966s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "cinder-quobyte-50725d86-eb11-4852-a182-445ad8906c16-7814617a-c78e-4309-8905-91b03f72fa53" by "_create_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD" returned: 1 in 0.466s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] 1ed22d45-f6bc-4b5e-9323-d50e93ac7b23 was raw, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:48 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae Sep 11 21:42:48 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abe97f8-9c7f-4559-a7a1-2c5bb7eaa759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac979d5-84f6-4186-84fd-637cecd88ade', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba0bc6b-d45e-403f-8bae-951be020585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-50725d86-eb11-4852-a182-445ad8906c16-7814617a-c78e-4309-8905-91b03f72fa53" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Creating volume 7814617a-c78e-4309-8905-91b03f72fa53 from snapshot 50725d86-eb11-4852-a182-445ad8906c16 {{(pid=87423) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:42:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "cinder-quobyte-7814617a-c78e-4309-8905-91b03f72fa53" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:49 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Volume volume-8ac979d5-84f6-4186-84fd-637cecd88ade (8ac979d5-84f6-4186-84fd-637cecd88ade): created successfully Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba0bc6b-d45e-403f-8bae-951be020585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Flow 'volume_create_manager' (0ffaa53c-9916-421c-b155-b81366439f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-7814617a-c78e-4309-8905-91b03f72fa53" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] snapshot: 50725d86-eb11-4852-a182-445ad8906c16, volume: 7814617a-c78e-4309-8905-91b03f72fa53, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:42:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a7cb98cb-a848-428f-b522-fc86b7a90d0c tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created volume successfully. Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[41288679-32e3-4696-9b60-051903f59faf]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:49 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb" returned: 0 in 0.431s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:49 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb Sep 11 21:42:49 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:49 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 Sep 11 21:42:49 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-8ac979d5-84f6-4186-84fd-637cecd88ade-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-8ac979d5-84f6-4186-84fd-637cecd88ade-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-quobyte-8ac979d5-84f6-4186-84fd-637cecd88ade" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:49 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-8ac979d5-84f6-4186-84fd-637cecd88ade" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-a2793044-5253-47c2-b6dd-de54618bdddb" returned: 0 in 0.329s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-a2793044-5253-47c2-b6dd-de54618bdddb" released by "delete_volume" :: held 0.802s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[297e3f3a-1209-42d3-8c4b-4a4666b89ca7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:49 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:49 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16" returned: 0 in 0.461s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f27715e8-1be4-4989-b9ae-48d766104a24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae" returned: 0 in 0.619s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ed22d45-f6bc-4b5e-9323-d50e93ac7b23_ej1p87_rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:42:49 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37270a2-65d7-4844-98b6-a32885ef5ebf]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:49 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae 1G Sep 11 21:42:49 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created reservations ['55a62a44-550e-44a9-83b2-07d898ee22da', 'fe290edc-830f-4286-acd6-686fa61f8277', '8b7c17b8-ad30-460f-8c0d-5c751386cbb6', 'e886cbc7-60f3-45cf-9213-1f8e8447af5a'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:49 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade Sep 11 21:42:49 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:49 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 Sep 11 21:42:49 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:49 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:49 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-71f2c26a-c2cf-405c-8b38-41abd92ea755-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-71f2c26a-c2cf-405c-8b38-41abd92ea755-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-quobyte-71f2c26a-c2cf-405c-8b38-41abd92ea755" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:50 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae 1G" returned: 0 in 0.485s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Downloaded image 1ed22d45-f6bc-4b5e-9323-d50e93ac7b23 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'metadata': {}}])) to volume b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Temporary image 1ed22d45-f6bc-4b5e-9323-d50e93ac7b23 for user a0603d9ac1d545139f6b06a6a1eb846d is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Marking volume b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Copying metadata from image 1ed22d45-f6bc-4b5e-9323-d50e93ac7b23 to b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Creating volume glance metadata for volume b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae backed by image 1ed22d45-f6bc-4b5e-9323-d50e93ac7b23 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5491142dca46c8df9401b58a330e8e5e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-71f2c26a-c2cf-405c-8b38-41abd92ea755" acquired by "delete_volume" :: waited 0.050s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:50 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade" returned: 0 in 0.591s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd9712c-b339-451f-a6b6-3138811de14b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:50 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade Sep 11 21:42:50 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:50 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.406s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Deleted volume successfully. Sep 11 21:42:50 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24" returned: 0 in 0.636s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-648e134f-8dd9-4d00-ab05-5a5bc1fcb7a1 tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-a2793044-5253-47c2-b6dd-de54618bdddb-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:50 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 Sep 11 21:42:50 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:50 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 Sep 11 21:42:50 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a9e131-60ed-4524-8cb4-98c5c68bf4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae', 'volume_size': 1, 'image_id': '1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5491142dca46c8df9401b58a330e8e5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe1d1f018e20417eafa6e5991f7e2eef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '194988e65569ed03bbfc58d58983e6817b25997c6c76e3f53791e01bb03b707c0d599b1a6727c57d81e6c54cf29497a23977fd72b3361afd2163334027baa156', 'id': '1ed22d45-f6bc-4b5e-9323-d50e93ac7b23', 'created_at': datetime.datetime(2026, 9, 11, 19, 42, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 42, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ed22d45-f6bc-4b5e-9323-d50e93ac7b23/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712ed1f3-e0f3-478c-8b86-568a816969ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Volume volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae (b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae): created successfully Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712ed1f3-e0f3-478c-8b86-568a816969ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Flow 'volume_create_manager' (23537379-1875-4a7e-be09-c01cc5eba5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e2813dad-7d67-468e-8b8d-330e972111ac tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Created volume successfully. Sep 11 21:42:50 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8ac979d5-84f6-4186-84fd-637cecd88ade" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-8ac979d5-84f6-4186-84fd-637cecd88ade" released by "delete_volume" :: held 0.947s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created reservations ['0420037d-a7db-475f-8725-ee5709657aee', 'b14e309c-6339-40ec-b312-d6bf6f3de5e6', '855405e5-c731-4d53-adc1-27f1177af78d', '493a9c71-807b-4baa-9e6c-ab854f42b996'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:50 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755" returned: 0 in 0.393s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:50 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755 Sep 11 21:42:50 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:50 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:50 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Acquiring lock "cinder-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:50 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-71f2c26a-c2cf-405c-8b38-41abd92ea755" returned: 0 in 0.403s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:50 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "cinder-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.359s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:50 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-71f2c26a-c2cf-405c-8b38-41abd92ea755" released by "delete_volume" :: held 0.921s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:51 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Deleted volume successfully. Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4352731-255d-45bc-a1f7-a5d819c7dcb4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-8ac979d5-84f6-4186-84fd-637cecd88ade-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Acquiring lock "cinder-quobyte-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "cinder-quobyte-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae" acquired by "delete_volume" :: waited 0.069s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe2ad0-2839-47a5-afb6-7f7aed548671]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created reservations ['f42f1d05-75b4-4c26-8aec-59510924e42d', '42bf8442-8ddd-4e56-a2cc-9097de7fd1e8', '46deeb68-ec0c-4283-b34e-249bb681743c', 'e6fb8330-0a06-4087-986b-8569d8f8c96e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:51 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae Sep 11 21:42:51 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:51 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:51 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-45f90049-6a0f-43da-a835-b50903c5d4be-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-45f90049-6a0f-43da-a835-b50903c5d4be-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-quobyte-45f90049-6a0f-43da-a835-b50903c5d4be" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-45f90049-6a0f-43da-a835-b50903c5d4be" acquired by "delete_volume" :: waited 0.045s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[71579f39-3aec-4f39-af83-71bb377467d0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:52 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.692s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:52 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Deleted volume successfully. Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-be981747-4b03-4630-ab4b-ab30c2a4f28b tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-71f2c26a-c2cf-405c-8b38-41abd92ea755-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:52 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae" returned: 0 in 1.108s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:52 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be Sep 11 21:42:52 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:52 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae Sep 11 21:42:52 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-5be5375c-9858-46cb-9457-6996d26487b1-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-5be5375c-9858-46cb-9457-6996d26487b1-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "cinder-quobyte-5be5375c-9858-46cb-9457-6996d26487b1" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-5be5375c-9858-46cb-9457-6996d26487b1" acquired by "delete_volume" :: waited 0.032s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[7137e135-3f32-49d3-a7fc-954bf718c858]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:52 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae" returned: 0 in 0.472s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "cinder-quobyte-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae" released by "delete_volume" :: held 1.717s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Created reservations ['1283cf7f-3d28-4ab8-aa31-957d5eb759bc', 'a0ecd2ea-8bf8-4ab3-ac18-6777a874a489', 'eb0d662e-0077-4ba1-9418-c5655c189ffb', 'f5cdd2c9-fe93-42ff-a3cd-1c85785abd73'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:53 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1 Sep 11 21:42:53 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:53 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be" returned: 0 in 1.199s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:53 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:53 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:53 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be Sep 11 21:42:53 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:53 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1" returned: 0 in 1.043s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:53 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1 Sep 11 21:42:53 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:54 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.716s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:54 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Deleted volume successfully. Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4b74aff5-a543-4656-b592-692b5b481f75 tempest-VolumeAndVolumeTypeFromImageTest-704753962 None] Lock "cinder-b4ee61ea-e6d4-4b2f-a93c-ea4bb9dcd6ae-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:54 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-45f90049-6a0f-43da-a835-b50903c5d4be" returned: 0 in 0.801s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-45f90049-6a0f-43da-a835-b50903c5d4be" released by "delete_volume" :: held 2.096s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created reservations ['dd67d45f-747a-416f-9373-00682094c7eb', '057be516-8811-4875-a0f6-3140dd7d40d1', '1734df1d-b903-40d3-af62-0b59265ca0dc', 'f318c549-79d3-4b4e-a04e-920706dda6ad'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:54 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5be5375c-9858-46cb-9457-6996d26487b1" returned: 0 in 0.550s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-quobyte-5be5375c-9858-46cb-9457-6996d26487b1" released by "delete_volume" :: held 1.737s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:54 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:54 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:54 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Created reservations ['1959a1ab-d67e-47d2-bd0b-2122fea3da32', 'a840610e-db81-4be2-a23e-517f1e9fece1', '79a52e46-6adb-4344-bf94-da54ad65d16d', '6ec1adb6-da91-4dea-bad0-9602e48b8dff'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:55 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:55 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:55 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.699s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:55 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Deleted volume successfully. Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c5eb9268-1325-4c8f-a74a-15ad09e00db4 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-45f90049-6a0f-43da-a835-b50903c5d4be-delete_volume" released by "delete_volume" :: held 3.564s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-6a8b15be-23f6-48ef-9c23-b804e7362b84-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-6a8b15be-23f6-48ef-9c23-b804e7362b84-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-quobyte-6a8b15be-23f6-48ef-9c23-b804e7362b84" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-6a8b15be-23f6-48ef-9c23-b804e7362b84" acquired by "delete_volume" :: waited 0.076s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:56 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 1.025s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Deleted volume successfully. Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c579638-e866-4a87-8f4f-bf326aa5b52e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e7012658-9a86-4eda-bc18-e1b2cd5a6f2e tempest-CreateVolumesFromSourceVolumeTest-23575905 None] Lock "cinder-5be5375c-9858-46cb-9457-6996d26487b1-delete_volume" released by "delete_volume" :: held 3.628s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:56 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 Sep 11 21:42:56 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53" returned: 0 in 6.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:42:56 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Converted 1024.00 MB image at 163.37 MB/s Sep 11 21:42:56 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 is being set with open permissions: ugo+rw Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:56 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 Sep 11 21:42:56 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:56 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84" returned: 0 in 0.530s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:56 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84 Sep 11 21:42:56 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:56 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53" returned: 0 in 0.271s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-7814617a-c78e-4309-8905-91b03f72fa53" released by "_copy_volume_from_snapshot" :: held 7.753s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-50725d86-eb11-4852-a182-445ad8906c16-7814617a-c78e-4309-8905-91b03f72fa53" released by "_create_volume_from_snapshot" :: held 7.853s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.905s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08dd370-a574-4487-aee3-d8c6a41d5308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7814617a-c78e-4309-8905-91b03f72fa53', 'volume_size': 1, 'snapshot_id': '50725d86-eb11-4852-a182-445ad8906c16'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ffa93d-c55c-4db2-b2d1-78a49a9b6c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:42:56 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Volume volume-7814617a-c78e-4309-8905-91b03f72fa53 (7814617a-c78e-4309-8905-91b03f72fa53): created successfully Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ffa93d-c55c-4db2-b2d1-78a49a9b6c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Flow 'volume_create_manager' (641ec6e5-127c-4d69-952f-588ec48c076f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:42:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a7dfd409-f8d5-424f-bc70-99e1c17ae304 tempest-VolumeDependencyTests-1589991020 None] Created volume successfully. Sep 11 21:42:56 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6a8b15be-23f6-48ef-9c23-b804e7362b84" returned: 0 in 0.322s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-6a8b15be-23f6-48ef-9c23-b804e7362b84" released by "delete_volume" :: held 0.961s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created reservations ['2d51ba8b-253a-4c3f-894c-73e9f8ffce96', '4ddf8e9d-bb27-4b9e-99cc-ef27e33bd26a', '07236339-de9d-4c93-ad6b-214d57f38bdc', 'e08c1529-9fcd-4609-b8bb-e1df718e3f07'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:57 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:57 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "cinder-50725d86-eb11-4852-a182-445ad8906c16-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-50725d86-eb11-4852-a182-445ad8906c16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "cinder-quobyte-f27715e8-1be4-4989-b9ae-48d766104a24" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:57 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.286s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Deleted volume successfully. Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-f27715e8-1be4-4989-b9ae-48d766104a24" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "cinder-quobyte-50725d86-eb11-4852-a182-445ad8906c16" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d77c308-e103-4738-90da-00a4d5f38ceb tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-6a8b15be-23f6-48ef-9c23-b804e7362b84-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-50725d86-eb11-4852-a182-445ad8906c16" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Deleting offline snapshot 50725d86-eb11-4852-a182-445ad8906c16 of volume f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] snapshot_file for this snap is: volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4eb333-b89a-43af-b699-9da4b890eaae]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:57 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 Sep 11 21:42:57 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:57 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16" returned: 0 in 0.414s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f27715e8-1be4-4989-b9ae-48d766104a24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d74e8e7-3dbe-4de0-97dd-ddf8ec94a21c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:58 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 Sep 11 21:42:58 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-627cbaae-b1b9-4883-b03d-652fd5667da4-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-627cbaae-b1b9-4883-b03d-652fd5667da4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-quobyte-627cbaae-b1b9-4883-b03d-652fd5667da4" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-627cbaae-b1b9-4883-b03d-652fd5667da4" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4873341a-e382-4b61-b801-d5f61fafacd9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:58 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4 Sep 11 21:42:58 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:58 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24" returned: 0 in 0.711s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:58 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 Sep 11 21:42:58 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:58 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4" returned: 0 in 0.453s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:58 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4 Sep 11 21:42:58 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:59 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16" returned: 0 in 0.440s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:59 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-627cbaae-b1b9-4883-b03d-652fd5667da4" returned: 0 in 0.309s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:59 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16 Sep 11 21:42:59 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-627cbaae-b1b9-4883-b03d-652fd5667da4" released by "delete_volume" :: held 0.827s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created reservations ['43c8c3a2-996f-4afc-b175-8d15577b41ee', '12d5a384-c204-45a1-b24e-32ee28d93077', '2ddb6150-7bac-4f0e-a81b-1b3291737b74', 'd10c555a-7099-43e5-b099-e7de890fecc0'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:59 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:42:59 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-f78b0832-1f66-4fdb-b4db-c42be4c4879d-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-f78b0832-1f66-4fdb-b4db-c42be4c4879d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:59 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24.50725d86-eb11-4852-a182-445ad8906c16" returned: 0 in 0.488s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-quobyte-f78b0832-1f66-4fdb-b4db-c42be4c4879d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-f78b0832-1f66-4fdb-b4db-c42be4c4879d" acquired by "delete_volume" :: waited 0.060s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-50725d86-eb11-4852-a182-445ad8906c16" released by "_delete_snapshot" :: held 2.226s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-f27715e8-1be4-4989-b9ae-48d766104a24" released by "delete_snapshot" :: held 2.268s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:59 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc0947b-2027-417f-9006-429f37f8f5bf]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.417s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:42:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Deleted volume successfully. Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-809e4f2e-6ff2-4867-8ced-13816dee14db tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-627cbaae-b1b9-4883-b03d-652fd5667da4-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Created reservations ['e0d0845f-186d-415f-b50b-517f0e9ace0e', '28653b2b-00a5-452d-803b-437c41db78ab', 'add90825-6ec1-4234-8989-c37ab70bace4', '5264814d-8fb0-4688-a188-634fdf5e9b66'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:42:59 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d Sep 11 21:42:59 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:42:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Delete snapshot completed successfully. Sep 11 21:42:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b155011c-376c-4c3b-ac3e-e6ec0eedd43a tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-50725d86-eb11-4852-a182-445ad8906c16-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:00 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d" returned: 0 in 0.448s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:00 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d Sep 11 21:43:00 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Flow 'volume_create_manager' (4b94f8fd-76b3-47f2-8337-57d1b302d24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02562cda-aa41-4dfb-baf9-8af9c10ac13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02562cda-aa41-4dfb-baf9-8af9c10ac13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4c23cc-27da-4b17-87a5-4200da0c9f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432c7ba2082b4f589d56d2a8411175c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:00Z,use_quota=True,user_id='00ccee3b5f9940f4a7e1b89a4993d0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b09abe-17e6-4365-bd4a-efe4de9028e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b09abe-17e6-4365-bd4a-efe4de9028e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5722cd7-47ed-4bb6-ab9d-b5b76e29ba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5722cd7-47ed-4bb6-ab9d-b5b76e29ba61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d4c23cc-27da-4b17-87a5-4200da0c9f90', 'volume_name': 'volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caa9c9e-0659-465c-9f66-d932ab2cdf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caa9c9e-0659-465c-9f66-d932ab2cdf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ee8b28-b8a2-4296-8eab-1ea59429895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:00 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Volume 6d4c23cc-27da-4b17-87a5-4200da0c9f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90', 'volume_size': 1} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4c23cc-27da-4b17-87a5-4200da0c9f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432c7ba2082b4f589d56d2a8411175c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:00Z,use_quota=True,user_id='00ccee3b5f9940f4a7e1b89a4993d0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Creating volume 6d4c23cc-27da-4b17-87a5-4200da0c9f90 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:00 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:00 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f78b0832-1f66-4fdb-b4db-c42be4c4879d" returned: 0 in 0.290s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:00 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 1073741824 Sep 11 21:43:00 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-f78b0832-1f66-4fdb-b4db-c42be4c4879d" released by "delete_volume" :: held 0.817s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created reservations ['d8ea7b9a-11ed-46e8-96fb-be33ff6dc80f', '4699ba3e-fcae-4022-8a7a-4be5ddb55d54', 'f7d8a62c-ee87-443e-b5cb-d5a59bc8ccba', '838fa90a-71ae-42f7-9a5b-7749265347f4'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:00 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:00 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "cinder-f27715e8-1be4-4989-b9ae-48d766104a24-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-f27715e8-1be4-4989-b9ae-48d766104a24-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "cinder-quobyte-f27715e8-1be4-4989-b9ae-48d766104a24" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-f27715e8-1be4-4989-b9ae-48d766104a24" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f47aceb-2197-45f3-bb32-af081d4c3347]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-eaf1b033-4359-4387-be05-c924e972264e-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-eaf1b033-4359-4387-be05-c924e972264e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-quobyte-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-quobyte-eaf1b033-4359-4387-be05-c924e972264e" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-eaf1b033-4359-4387-be05-c924e972264e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Deleting offline snapshot eaf1b033-4359-4387-be05-c924e972264e of volume b0338d1b-be30-4da6-8252-8e7c50f3ba1c {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] snapshot_file for this snap is: volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d6d9f-8e13-48ac-9bda-ec8775694600]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:01 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 Sep 11 21:43:01 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:01 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 1073741824" returned: 0 in 0.643s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:01 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.516s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Deleted volume successfully. Sep 11 21:43:01 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e Sep 11 21:43:01 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:01 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 Sep 11 21:43:01 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-82d2e156-5947-4c72-b3f8-deceb9ba8d57 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-f78b0832-1f66-4fdb-b4db-c42be4c4879d-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (1fd0e0f9-4518-4d99-8c80-31fe171e1744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c72c79-183c-4489-99ba-da4ca1448818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c72c79-183c-4489-99ba-da4ca1448818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235596762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bad3959-201c-4e79-bd1b-7c92d091f82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:01Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae96c89-79a4-4c20-b71b-670fc86f752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:01 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae96c89-79a4-4c20-b71b-670fc86f752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a78d91-093d-4e43-8d15-9b094c67bd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a78d91-093d-4e43-8d15-9b094c67bd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bad3959-201c-4e79-bd1b-7c92d091f82c', 'volume_name': 'volume-5bad3959-201c-4e79-bd1b-7c92d091f82c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:01 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7d70e1-235e-4e1b-9612-ea6ce31d0cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7d70e1-235e-4e1b-9612-ea6ce31d0cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1178ea01-b485-4aa0-8dfe-54ba414404a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:01 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Volume 5bad3959-201c-4e79-bd1b-7c92d091f82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bad3959-201c-4e79-bd1b-7c92d091f82c', 'volume_size': 1} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24" returned: 0 in 0.718s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e" returned: 0 in 0.526s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:43:01 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24 Sep 11 21:43:01 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aa63c4-a866-4520-a971-8168a4ee00b3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:01 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90" returned: 0 in 0.411s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235596762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bad3959-201c-4e79-bd1b-7c92d091f82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:01Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Creating volume 5bad3959-201c-4e79-bd1b-7c92d091f82c {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:01 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ee8b28-b8a2-4296-8eab-1ea59429895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:01 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c 1073741824 Sep 11 21:43:01 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254df2bc-9736-45c9-8a60-255191d1925a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:01 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Volume volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 (6d4c23cc-27da-4b17-87a5-4200da0c9f90): created successfully Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254df2bc-9736-45c9-8a60-255191d1925a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Flow 'volume_create_manager' (4b94f8fd-76b3-47f2-8337-57d1b302d24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:01 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c Sep 11 21:43:01 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-231f01a6-c7b6-4165-bf43-f798da512e23 tempest-CinderUnicodeTest-1074067648 None] Created volume successfully. Sep 11 21:43:01 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f27715e8-1be4-4989-b9ae-48d766104a24" returned: 0 in 0.418s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-f27715e8-1be4-4989-b9ae-48d766104a24" released by "delete_volume" :: held 1.226s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Created reservations ['64a9d7c0-4ac1-4c3e-94ca-9ec85b1bfedf', 'b9b31a8e-965c-4e18-95bc-af8cf8b52a7e', '5f6d7137-7c27-44c9-90d6-e7f4c75cd23d', 'c53ce82b-6805-447b-a40e-954dd444fb2d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:02 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" returned: 0 in 0.556s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:02 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e Sep 11 21:43:02 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (4abd8f07-5dba-4d67-a142-fd91bee77223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706a0c35-44b4-43a6-947b-850add56f937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706a0c35-44b4-43a6-947b-850add56f937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-662202681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50be6ac5-040c-492f-89a0-837e541c5cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:02Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d286e0-ef54-4e35-8c17-ee34a52b35ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d286e0-ef54-4e35-8c17-ee34a52b35ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681c7a4f-adea-4f0c-815f-9abf1b41086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681c7a4f-adea-4f0c-815f-9abf1b41086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50be6ac5-040c-492f-89a0-837e541c5cf8', 'volume_name': 'volume-50be6ac5-040c-492f-89a0-837e541c5cf8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:02 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882c9794-3a28-400b-aac9-f24c4983d965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882c9794-3a28-400b-aac9-f24c4983d965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bc9872-dd1d-41b3-aa06-2241f476d724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Volume 50be6ac5-040c-492f-89a0-837e541c5cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50be6ac5-040c-492f-89a0-837e541c5cf8', 'volume_size': 1} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c 1073741824" returned: 0 in 0.693s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:02 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:02 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c Sep 11 21:43:02 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (f8895506-55fc-4fcb-8303-53952a6ab30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f66fac-6bf5-421a-a7eb-54f700b81c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f66fac-6bf5-421a-a7eb-54f700b81c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1634950659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045b3a26-1214-4c55-9416-8c23905cb219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:03Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ff5de2-e6b4-4079-8076-cbf15a71b4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ff5de2-e6b4-4079-8076-cbf15a71b4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a721e4-1e60-4008-ac60-599c590e9bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a721e4-1e60-4008-ac60-599c590e9bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045b3a26-1214-4c55-9416-8c23905cb219', 'volume_name': 'volume-045b3a26-1214-4c55-9416-8c23905cb219', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b11928e-7a32-4ebe-9f2a-d580704d0d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b11928e-7a32-4ebe-9f2a-d580704d0d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098b1826-f677-4edb-839c-1692e21a0563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:02 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Volume 045b3a26-1214-4c55-9416-8c23905cb219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045b3a26-1214-4c55-9416-8c23905cb219', 'volume_size': 1} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:02 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e" returned: 0 in 0.681s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:02 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e Sep 11 21:43:02 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:02 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c" returned: 0 in 0.503s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-662202681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50be6ac5-040c-492f-89a0-837e541c5cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:02Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Creating volume 50be6ac5-040c-492f-89a0-837e541c5cf8 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:02 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:03 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.634s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:03 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8 1073741824 Sep 11 21:43:03 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Deleted volume successfully. Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1178ea01-b485-4aa0-8dfe-54ba414404a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bad3959-201c-4e79-bd1b-7c92d091f82c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a87a5c-b7d5-4528-a94a-5243b5abcbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5644f58c-7431-489a-80f7-57f8e6873de7 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-f27715e8-1be4-4989-b9ae-48d766104a24-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:03 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Volume volume-5bad3959-201c-4e79-bd1b-7c92d091f82c (5bad3959-201c-4e79-bd1b-7c92d091f82c): created successfully Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a87a5c-b7d5-4528-a94a-5243b5abcbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (1fd0e0f9-4518-4d99-8c80-31fe171e1744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (08d1f4c5-072a-48e7-a33e-ca8a01376f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc15cc1a-607a-420e-b94b-774412cf3881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-fcdb7330-936c-4ab4-a891-c8c3088eb1be tempest-CreateVolumesFromImageTest-614842421 None] Created volume successfully. Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc15cc1a-607a-420e-b94b-774412cf3881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924659464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8798eb-fcec-4cdd-869d-d53f148f8d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:03Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81de062a-032a-485d-aaf6-7343ff017b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81de062a-032a-485d-aaf6-7343ff017b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfe9e5b-fd6f-4e0b-a589-a4ec4029ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfe9e5b-fd6f-4e0b-a589-a4ec4029ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8798eb-fcec-4cdd-869d-d53f148f8d05', 'volume_name': 'volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a97a8c1-77c0-4c16-9dd5-b3cb84086071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a97a8c1-77c0-4c16-9dd5-b3cb84086071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715e8d9e-d47b-4545-a3aa-d134bb2720d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:03 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Volume 9e8798eb-fcec-4cdd-869d-d53f148f8d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05', 'volume_size': 1} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:03 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c.eaf1b033-4359-4387-be05-c924e972264e" returned: 0 in 0.576s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-eaf1b033-4359-4387-be05-c924e972264e" released by "_delete_snapshot" :: held 2.496s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" released by "delete_snapshot" :: held 2.536s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created reservations ['b565bf57-a6a7-4a24-a590-5ea1c3a0dc7c', '14dba622-1d66-4bda-89d2-00ba84dff078', 'adf5818e-bf8d-4496-90e1-cf1c077f6b93', '511eaea8-e779-4f33-a915-2d71ac9f4952'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:03 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "cinder-7814617a-c78e-4309-8905-91b03f72fa53-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8 1073741824" returned: 0 in 0.690s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-7814617a-c78e-4309-8905-91b03f72fa53-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:03 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Delete snapshot completed successfully. Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-160a7502-b14b-4de6-8b02-8b472fc73389 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-eaf1b033-4359-4387-be05-c924e972264e-delete_snapshot" released by "delete_snapshot" :: held 2.872s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "cinder-quobyte-7814617a-c78e-4309-8905-91b03f72fa53" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:03 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8 Sep 11 21:43:03 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-7814617a-c78e-4309-8905-91b03f72fa53" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94a52d2-1915-448f-b951-15ea516c74bd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:03 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 Sep 11 21:43:03 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (ef5872ad-3ff0-46e1-8cb6-54a460c1cfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54de3879-3beb-4ec7-af82-965995da8017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54de3879-3beb-4ec7-af82-965995da8017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489843220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6455b2-15bb-436e-a3ff-aa11df30a665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:04Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37cd4ec-6cb5-4ca3-adef-526f1685b61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37cd4ec-6cb5-4ca3-adef-526f1685b61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4865896f-3b4e-43ee-bfcb-fadda0728a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4865896f-3b4e-43ee-bfcb-fadda0728a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd6455b2-15bb-436e-a3ff-aa11df30a665', 'volume_name': 'volume-fd6455b2-15bb-436e-a3ff-aa11df30a665', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fc11a4-5d2a-4a33-a808-632c48e58059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fc11a4-5d2a-4a33-a808-632c48e58059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb47933d-4d1d-43d4-bda6-1fee6f75e86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Volume fd6455b2-15bb-436e-a3ff-aa11df30a665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd6455b2-15bb-436e-a3ff-aa11df30a665', 'volume_size': 1} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8" returned: 0 in 0.367s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.352s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1634950659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045b3a26-1214-4c55-9416-8c23905cb219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:03Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Creating volume 045b3a26-1214-4c55-9416-8c23905cb219 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:04 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:04 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219 1073741824 Sep 11 21:43:04 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Flow 'volume_create_manager' (05408dc7-5f2a-4f2f-bb8b-b9519499bee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbe8b78-67ec-4b5b-8718-7296fc100625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bc9872-dd1d-41b3-aa06-2241f476d724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50be6ac5-040c-492f-89a0-837e541c5cf8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (190d7bd0-24c4-4447-8f0c-4f7785d7796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbe8b78-67ec-4b5b-8718-7296fc100625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1851382264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b32f8c0-8e0e-4766-b451-a2a603fb02e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432c7ba2082b4f589d56d2a8411175c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:04Z,use_quota=True,user_id='00ccee3b5f9940f4a7e1b89a4993d0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc6bec9-d4ab-415d-b9b1-f2bd4abba706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc6bec9-d4ab-415d-b9b1-f2bd4abba706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80380343-ebca-4b3c-88ba-fa3db179fff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80380343-ebca-4b3c-88ba-fa3db179fff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b32f8c0-8e0e-4766-b451-a2a603fb02e5', 'volume_name': 'volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eb884c-2a2c-490a-9893-90bef0b7a556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eb884c-2a2c-490a-9893-90bef0b7a556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad80a635-d4d7-42a8-8543-b57c8255c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Volume 1b32f8c0-8e0e-4766-b451-a2a603fb02e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5', 'volume_size': 1} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:04 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Volume volume-50be6ac5-040c-492f-89a0-837e541c5cf8 (50be6ac5-040c-492f-89a0-837e541c5cf8): created successfully Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (190d7bd0-24c4-4447-8f0c-4f7785d7796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (4abd8f07-5dba-4d67-a142-fd91bee77223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:04 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-757b2575-e09f-48fe-8914-2aaf567d5906 tempest-CreateVolumesFromImageTest-614842421 None] Created volume successfully. Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53" returned: 0 in 0.429s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:04 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53 Sep 11 21:43:04 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:04 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219 1073741824" returned: 0 in 0.420s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:04 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7814617a-c78e-4309-8905-91b03f72fa53" returned: 0 in 0.297s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-quobyte-7814617a-c78e-4309-8905-91b03f72fa53" released by "delete_volume" :: held 0.794s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:04 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219 Sep 11 21:43:04 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Created reservations ['44ef9b68-9f70-4015-87e3-c7d71d37c48b', 'f2d4b385-6f78-4856-a5d7-10aba124737f', 'e56625fb-317e-464d-90e4-d98e6fdf0933', 'b47b8738-87eb-400a-8ecd-839feb81cb15'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-b0338d1b-be30-4da6-8252-8e7c50f3ba1c-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-b0338d1b-be30-4da6-8252-8e7c50f3ba1c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "cinder-quobyte-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" acquired by "delete_volume" :: waited 0.033s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f913ab-f688-4db5-a364-c7264e4b30e7]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:04 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219" returned: 0 in 0.341s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.623s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924659464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8798eb-fcec-4cdd-869d-d53f148f8d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:03Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Creating volume 9e8798eb-fcec-4cdd-869d-d53f148f8d05 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:04 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:04 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:04 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098b1826-f677-4edb-839c-1692e21a0563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045b3a26-1214-4c55-9416-8c23905cb219', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:04 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d523beb1-d730-4280-8a87-1ad9a79754ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:05 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Volume volume-045b3a26-1214-4c55-9416-8c23905cb219 (045b3a26-1214-4c55-9416-8c23905cb219): created successfully Sep 11 21:43:05 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 1073741824 Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d523beb1-d730-4280-8a87-1ad9a79754ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:05 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (f8895506-55fc-4fcb-8303-53952a6ab30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e447976a-14f4-4922-aae3-4c8ba0a01673 tempest-CreateVolumesFromImageTest-614842421 None] Created volume successfully. Sep 11 21:43:05 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c Sep 11 21:43:05 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:05 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.355s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:05 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Deleted volume successfully. Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-66eefecf-cc6e-4698-b727-e3be6f2d7178 tempest-VolumeDependencyTests-1589991020 None] Lock "cinder-7814617a-c78e-4309-8905-91b03f72fa53-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:05 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" returned: 0 in 0.531s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:05 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c Sep 11 21:43:05 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:05 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 1073741824" returned: 0 in 0.570s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:05 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 Sep 11 21:43:05 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:05 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" returned: 0 in 0.321s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-quobyte-b0338d1b-be30-4da6-8252-8e7c50f3ba1c" released by "delete_volume" :: held 0.996s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:05 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05" returned: 0 in 0.309s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.782s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489843220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6455b2-15bb-436e-a3ff-aa11df30a665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7b7d2b522422792dbc0c387300df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:04Z,use_quota=True,user_id='d9042cf14f874a1186cd904f6cac984a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Creating volume fd6455b2-15bb-436e-a3ff-aa11df30a665 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:05 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715e8d9e-d47b-4545-a3aa-d134bb2720d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f92e48-f36a-4e48-bda6-86c85940a0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:05 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 1073741824 Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Created reservations ['32431be1-d00b-467f-b2f5-0b8c96cb2f67', '545fa43d-c747-4efb-baa4-1f9425088697', '28bb3ec0-9eb5-4c9c-9c30-825b9be4e3fd', 'bd23095a-fe60-4631-888b-1809810911a4'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:05 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:05 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Volume volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 (9e8798eb-fcec-4cdd-869d-d53f148f8d05): created successfully Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f92e48-f36a-4e48-bda6-86c85940a0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:05 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (08d1f4c5-072a-48e7-a33e-ca8a01376f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2a1befd9-ec06-47ad-9523-048f97db5b53 tempest-CreateVolumesFromImageTest-614842421 None] Created volume successfully. Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:06 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:06 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:06 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.287s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Deleted volume successfully. Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-828aaea3-6a80-44e1-b801-3cb978a5bd42 tempest-CreateVolumesFromSnapshotTest-1241571483 None] Lock "cinder-b0338d1b-be30-4da6-8252-8e7c50f3ba1c-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:06 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 1073741824" returned: 0 in 0.579s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:06 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 Sep 11 21:43:06 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:06 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665" returned: 0 in 0.290s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.558s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1851382264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b32f8c0-8e0e-4766-b451-a2a603fb02e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432c7ba2082b4f589d56d2a8411175c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:04Z,use_quota=True,user_id='00ccee3b5f9940f4a7e1b89a4993d0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Creating volume 1b32f8c0-8e0e-4766-b451-a2a603fb02e5 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:06 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb47933d-4d1d-43d4-bda6-1fee6f75e86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd6455b2-15bb-436e-a3ff-aa11df30a665', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:06 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 1073741824 Sep 11 21:43:06 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01264e1d-16bc-43a4-9341-63cf2810ffe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:06 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Volume volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 (fd6455b2-15bb-436e-a3ff-aa11df30a665): created successfully Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01264e1d-16bc-43a4-9341-63cf2810ffe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:06 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Flow 'volume_create_manager' (ef5872ad-3ff0-46e1-8cb6-54a460c1cfc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-09b02f5f-9aaf-4ff5-a90c-2a317530bf07 tempest-CreateVolumesFromImageTest-614842421 None] Created volume successfully. Sep 11 21:43:07 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 1073741824" returned: 0 in 0.549s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-fd6455b2-15bb-436e-a3ff-aa11df30a665-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-fd6455b2-15bb-436e-a3ff-aa11df30a665-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:07 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 Sep 11 21:43:07 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-quobyte-fd6455b2-15bb-436e-a3ff-aa11df30a665" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-fd6455b2-15bb-436e-a3ff-aa11df30a665" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce155037-7704-4f4b-9228-3cfcc6dcff77]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:07 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 Sep 11 21:43:07 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:07 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" returned: 0 in 0.358s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad80a635-d4d7-42a8-8543-b57c8255c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1637a3-8021-4648-85ec-a156daedae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Volume volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 (1b32f8c0-8e0e-4766-b451-a2a603fb02e5): created successfully Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1637a3-8021-4648-85ec-a156daedae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Flow 'volume_create_manager' (05408dc7-5f2a-4f2f-bb8b-b9519499bee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:07 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-343c1f92-6398-4354-af4c-39a67e719902 tempest-CinderUnicodeTest-1074067648 None] Created volume successfully. Sep 11 21:43:08 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665" returned: 0 in 0.558s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:08 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665 Sep 11 21:43:08 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Creating offline snapshot 8aea4d19-bd91-43d6-ad96-4ea27bd11870 of volume 1b32f8c0-8e0e-4766-b451-a2a603fb02e5 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[76723980-34a3-46d2-ba77-e79f30bc635e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:08 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-fd6455b2-15bb-436e-a3ff-aa11df30a665" returned: 0 in 0.379s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-fd6455b2-15bb-436e-a3ff-aa11df30a665" released by "delete_volume" :: held 1.009s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Created reservations ['a222d7bd-2fb7-44f5-a64c-f02665bb1988', '7622f703-1c85-4c4d-a5f7-58210f1f88d5', '2b06746a-0f19-4a5e-9e04-ae0454deea4b', '96694968-43c5-4862-81dc-446d22ef0c6d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:08 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 Sep 11 21:43:08 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:08 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:08 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:09 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" returned: 0 in 0.560s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:09 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 1G Sep 11 21:43:09 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:09 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.358s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Deleted volume successfully. Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2f120945-336c-4c76-a459-b88f919764b5 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-fd6455b2-15bb-436e-a3ff-aa11df30a665-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:09 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 1G" returned: 0 in 0.538s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:09 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 Sep 11 21:43:09 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-9e8798eb-fcec-4cdd-869d-d53f148f8d05-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-9e8798eb-fcec-4cdd-869d-d53f148f8d05-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-quobyte-9e8798eb-fcec-4cdd-869d-d53f148f8d05" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-9e8798eb-fcec-4cdd-869d-d53f148f8d05" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5d4724-df22-46f4-bbb7-7889a6ce41b3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:10 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870" returned: 0 in 0.520s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:10 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 is being set with open permissions: ugo+rw Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:10 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 Sep 11 21:43:10 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 Sep 11 21:43:10 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:10 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (30efafdf-fec2-4a37-b462-f78cf5ef2221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f05e9c0-8f0a-4a75-9bba-6b4da03c2dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f05e9c0-8f0a-4a75-9bba-6b4da03c2dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1948170626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b3420c-59f6-4ff6-84dc-d092332f5b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:10Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3491f2-e431-4866-a112-5add3bdddade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3491f2-e431-4866-a112-5add3bdddade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6123b0-d01a-4b6f-8418-187e7fa0c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6123b0-d01a-4b6f-8418-187e7fa0c262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b3420c-59f6-4ff6-84dc-d092332f5b9c', 'volume_name': 'volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f25cbbe-ab35-4a12-868f-9eee40888a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f25cbbe-ab35-4a12-868f-9eee40888a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c719dd7-b301-49d6-bfd2-a3d6f1e5d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:10 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Volume 06b3420c-59f6-4ff6-84dc-d092332f5b9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c', 'volume_size': 1} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:10 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870" returned: 0 in 0.280s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:10 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05" returned: 0 in 0.515s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:10 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.info Sep 11 21:43:10 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:10 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05 Sep 11 21:43:10 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:10 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.info" returned: 0 in 0.290s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:10 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.info is being set with open permissions: ugo+rw Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:10 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9e8798eb-fcec-4cdd-869d-d53f148f8d05" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:10 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.info Sep 11 21:43:10 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-9e8798eb-fcec-4cdd-869d-d53f148f8d05" released by "delete_volume" :: held 0.913s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Created reservations ['ec156cf8-69c8-4f00-bcd4-9f8c4a6c774a', 'f5e25a4d-4ad5-4e0d-adf8-984c9575aef4', '17c116b4-0246-4b0f-b948-a4a4807c714b', '98d73ecb-62a0-44f7-a919-079e0e2d2de0'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:10 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:10 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:11 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.info" returned: 0 in 0.316s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1948170626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b3420c-59f6-4ff6-84dc-d092332f5b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:10Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Creating volume 06b3420c-59f6-4ff6-84dc-d092332f5b9c {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:11 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:11 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c 1073741824 Sep 11 21:43:11 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e24c16a5-a3de-4340-91d1-a649157acc65 tempest-CinderUnicodeTest-1074067648 None] Create snapshot completed successfully Sep 11 21:43:11 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Deleted volume successfully. Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-50b984bc-fb39-49f0-a1a8-53051ffbaa0d tempest-ProjectAdminTests-2112284798 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2010765075684, 'free_capacity_gb': 1773.2010765075684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87423) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-5d72f9b3-3cf9-452e-96ff-7fa48c653ca2 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-9e8798eb-fcec-4cdd-869d-d53f148f8d05-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:11 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c 1073741824" returned: 0 in 0.482s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "cinder-8aea4d19-bd91-43d6-ad96-4ea27bd11870-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:11 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c Sep 11 21:43:11 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-8aea4d19-bd91-43d6-ad96-4ea27bd11870-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "cinder-quobyte-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-quobyte-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "cinder-quobyte-8aea4d19-bd91-43d6-ad96-4ea27bd11870" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-quobyte-8aea4d19-bd91-43d6-ad96-4ea27bd11870" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Deleting offline snapshot 8aea4d19-bd91-43d6-ad96-4ea27bd11870 of volume 1b32f8c0-8e0e-4766-b451-a2a603fb02e5 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] snapshot_file for this snap is: volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e66a0a-0473-4afd-b97d-8c2496d73147]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:11 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 Sep 11 21:43:11 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:11 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c" returned: 0 in 0.309s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c719dd7-b301-49d6-bfd2-a3d6f1e5d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1c2c0a-6fa1-4767-b31f-bc2f4d7238ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:11 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Volume volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c (06b3420c-59f6-4ff6-84dc-d092332f5b9c): created successfully Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1c2c0a-6fa1-4767-b31f-bc2f4d7238ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (30efafdf-fec2-4a37-b462-f78cf5ef2221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cfa5c809-b096-4820-8696-fca5f34e83a9 tempest-ProjectReaderTests-1143561272 None] Created volume successfully. Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-045b3a26-1214-4c55-9416-8c23905cb219-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-045b3a26-1214-4c55-9416-8c23905cb219-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-quobyte-045b3a26-1214-4c55-9416-8c23905cb219" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-045b3a26-1214-4c55-9416-8c23905cb219" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a391c3c-6619-4219-ba5b-90175cff3629]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:12 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870" returned: 0 in 0.460s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[07025021-9434-4a02-aa93-fbb47277e1c0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:12 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219 Sep 11 21:43:12 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:12 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 Sep 11 21:43:12 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Creating offline snapshot 5b35babb-8ed4-48f2-8333-e99ac4389c68 of volume 06b3420c-59f6-4ff6-84dc-d092332f5b9c {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c25cf-1708-4b79-8772-e1fba0acf235]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:12 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219" returned: 0 in 0.526s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:12 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c Sep 11 21:43:12 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:12 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219 Sep 11 21:43:12 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:12 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" returned: 0 in 0.492s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:12 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 Sep 11 21:43:12 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:13 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-045b3a26-1214-4c55-9416-8c23905cb219" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:13 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-045b3a26-1214-4c55-9416-8c23905cb219" released by "delete_volume" :: held 0.887s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c" returned: 0 in 0.481s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:13 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 1G Sep 11 21:43:13 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Created reservations ['de86015b-8e4d-4179-9d6c-a462dcea9782', '192e73d2-9e9c-4b1a-8e61-141b7e95e275', 'f8368144-494c-41d1-94c4-ec1fc4a5f2f5', 'a8fba495-982e-4cde-ab35-fd9f435e9e37'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:13 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870" returned: 0 in 0.504s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:13 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:13 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-50be6ac5-040c-492f-89a0-837e541c5cf8-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:13 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870 Sep 11 21:43:13 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-50be6ac5-040c-492f-89a0-837e541c5cf8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-quobyte-50be6ac5-040c-492f-89a0-837e541c5cf8" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-50be6ac5-040c-492f-89a0-837e541c5cf8" acquired by "delete_volume" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:13 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.322s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6927f3-77a1-4f5a-9b24-44d3fe3fdb09]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:13 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Deleted volume successfully. Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dfd01c59-8aed-40ec-b451-0a5e23ce5cca tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-045b3a26-1214-4c55-9416-8c23905cb219-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:13 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5.8aea4d19-bd91-43d6-ad96-4ea27bd11870" returned: 0 in 0.384s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:13 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 1G" returned: 0 in 0.616s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:13 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 Sep 11 21:43:13 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:13 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8 Sep 11 21:43:13 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-quobyte-8aea4d19-bd91-43d6-ad96-4ea27bd11870" released by "_delete_snapshot" :: held 2.021s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-quobyte-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" released by "delete_snapshot" :: held 2.066s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Created reservations ['41a9b4c5-a160-42d1-9625-57b4a5e558d8', '105f281c-6281-47fe-985c-316102444c8f', '0db88b5f-3631-4c5c-b9cc-c1f63599bae8', '63c84ac1-5c4d-4409-9c3d-48c303cf53aa'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:13 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Delete snapshot completed successfully. Sep 11 21:43:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-69fa8b3d-9c50-4f42-93f8-1a3891ec3d77 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-8aea4d19-bd91-43d6-ad96-4ea27bd11870-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:14 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8" returned: 0 in 0.480s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:14 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68" returned: 0 in 0.404s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:14 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 is being set with open permissions: ugo+rw Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:14 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8 Sep 11 21:43:14 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:14 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 Sep 11 21:43:14 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:14 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68" returned: 0 in 0.256s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:14 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-50be6ac5-040c-492f-89a0-837e541c5cf8" returned: 0 in 0.282s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-50be6ac5-040c-492f-89a0-837e541c5cf8" released by "delete_volume" :: held 0.824s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:14 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.info Sep 11 21:43:14 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Created reservations ['6c3226cf-b655-4a4c-aa0d-627b3bc14228', '165c487c-81f1-46b2-93fb-c3383839a53e', '06473c32-9335-44fe-93c4-7e6e8760e1dd', '754308bb-ef25-42e6-a3d3-e918c4f19965'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:14 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:14 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:14 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.info" returned: 0 in 0.288s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:14 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.info is being set with open permissions: ugo+rw Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:14 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.info Sep 11 21:43:14 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:14 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:14 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Deleted volume successfully. Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c8f30589-3a68-43f3-bbef-76728501ef3d tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-50be6ac5-040c-492f-89a0-837e541c5cf8-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "cinder-1b32f8c0-8e0e-4766-b451-a2a603fb02e5-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-1b32f8c0-8e0e-4766-b451-a2a603fb02e5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "cinder-quobyte-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-quobyte-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:15 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.info" returned: 0 in 0.379s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed353a3-5ab7-4a18-803e-aceab5829dc5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:15 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-12790ff1-242e-4e2a-a3aa-9b7c050a5bc5 tempest-ProjectReaderTests-1143561272 None] Create snapshot completed successfully Sep 11 21:43:15 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 Sep 11 21:43:15 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:15 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" returned: 0 in 0.387s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:15 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5 Sep 11 21:43:15 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-5bad3959-201c-4e79-bd1b-7c92d091f82c-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-5bad3959-201c-4e79-bd1b-7c92d091f82c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "cinder-quobyte-5bad3959-201c-4e79-bd1b-7c92d091f82c" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-5bad3959-201c-4e79-bd1b-7c92d091f82c" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d0db0d-2d5c-45e2-a56b-60da65ac5c8e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:15 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" returned: 0 in 0.340s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:15 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c Sep 11 21:43:15 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:15 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:15 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-quobyte-1b32f8c0-8e0e-4766-b451-a2a603fb02e5" released by "delete_volume" :: held 0.808s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Created reservations ['e8420124-fc70-4cc1-8a48-334255090cff', 'd48f65bf-82bb-458f-9e6d-f1658c22674b', 'ecf5ef69-d17c-447d-95c8-bc64e0cae581', '5bc99540-ea40-4ab7-ba7e-50b2d21150ea'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-5b35babb-8ed4-48f2-8333-e99ac4389c68-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Lock "cinder-5b35babb-8ed4-48f2-8333-e99ac4389c68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-06b3420c-59f6-4ff6-84dc-d092332f5b9c" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-06b3420c-59f6-4ff6-84dc-d092332f5b9c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-5b35babb-8ed4-48f2-8333-e99ac4389c68" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-5b35babb-8ed4-48f2-8333-e99ac4389c68" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Deleting offline snapshot 5b35babb-8ed4-48f2-8333-e99ac4389c68 of volume 06b3420c-59f6-4ff6-84dc-d092332f5b9c {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] snapshot_file for this snap is: volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd134e8-94d6-4435-866c-644701f813aa]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:16 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:16 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:16 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "cinder-6d4c23cc-27da-4b17-87a5-4200da0c9f90-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.406s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:43:16 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c" returned: 0 in 0.519s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-6d4c23cc-27da-4b17-87a5-4200da0c9f90-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:16 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c Sep 11 21:43:16 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "cinder-quobyte-6d4c23cc-27da-4b17-87a5-4200da0c9f90" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:16 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 Sep 11 21:43:16 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-quobyte-6d4c23cc-27da-4b17-87a5-4200da0c9f90" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb84a4-2a0b-42a1-b9f2-912d59627199]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:16 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.314s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Deleted volume successfully. Sep 11 21:43:16 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 Sep 11 21:43:16 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0093be35-eba3-47d5-bd91-fa80a57d0ee9 tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-1b32f8c0-8e0e-4766-b451-a2a603fb02e5-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:16 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-5bad3959-201c-4e79-bd1b-7c92d091f82c" returned: 0 in 0.306s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-quobyte-5bad3959-201c-4e79-bd1b-7c92d091f82c" released by "delete_volume" :: held 0.872s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:16 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68" returned: 0 in 0.462s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d149ff61-16c7-44cf-b2bf-91298b438bee]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Created reservations ['48a12ebc-280a-4f9b-8d70-9eeb0e08d82b', '57a932ab-4b7d-4645-8ad9-368931a1cef6', '64e2b975-7274-4b6f-bd72-9eef2f2d10b5', '37a8afa7-6ad5-4216-a4eb-7b192d642791'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:16 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:16 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c Sep 11 21:43:16 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90" returned: 0 in 0.459s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:16 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:16 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:16 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90 Sep 11 21:43:16 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:17 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.315s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:17 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-6d4c23cc-27da-4b17-87a5-4200da0c9f90" returned: 0 in 0.309s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:17 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Deleted volume successfully. Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c" returned: 0 in 0.489s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-quobyte-6d4c23cc-27da-4b17-87a5-4200da0c9f90" released by "delete_volume" :: held 0.834s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f26e0a77-3217-4b11-8092-525fb88042b7 tempest-CreateVolumesFromImageTest-614842421 None] Lock "cinder-5bad3959-201c-4e79-bd1b-7c92d091f82c-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:17 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 Sep 11 21:43:17 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Created reservations ['db9d7d39-2e29-4585-94f9-9becf309ee73', '7c6babdc-66a6-4da6-ac73-2dba4ac75d33', 'f2d2c401-132b-4f78-8d2e-ef565a42b42e', 'bc1026d7-836f-4173-9159-825a9aa1d00e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:17 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:17 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:17 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68" returned: 0 in 0.441s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:17 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.319s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:17 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68 Sep 11 21:43:17 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Deleted volume successfully. Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ecdb5b30-0abc-4fb9-95ab-ebca4172518a tempest-CinderUnicodeTest-1074067648 None] Lock "cinder-6d4c23cc-27da-4b17-87a5-4200da0c9f90-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:17 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c.5b35babb-8ed4-48f2-8333-e99ac4389c68" returned: 0 in 0.274s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-5b35babb-8ed4-48f2-8333-e99ac4389c68" released by "_delete_snapshot" :: held 1.833s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-06b3420c-59f6-4ff6-84dc-d092332f5b9c" released by "delete_snapshot" :: held 1.871s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:17 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Created reservations ['4411aa9c-580b-4104-ae32-08f9f959f0a0', 'faa27d6a-0ac9-4641-9420-52637c9ced9d', '2a3ae6cd-a5cc-4b4c-a868-57828b5a7e83', '733a45d5-471e-4056-a1b9-8a4aa84524ad'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:17 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Delete snapshot completed successfully. Sep 11 21:43:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1f792519-6036-4264-9628-ff4c6680ce9d tempest-ProjectReaderTests-1143561272 None] Lock "cinder-5b35babb-8ed4-48f2-8333-e99ac4389c68-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-06b3420c-59f6-4ff6-84dc-d092332f5b9c-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-06b3420c-59f6-4ff6-84dc-d092332f5b9c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-06b3420c-59f6-4ff6-84dc-d092332f5b9c" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:18 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-06b3420c-59f6-4ff6-84dc-d092332f5b9c" acquired by "delete_volume" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:18 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc5afc7-3db6-4a30-9f73-f3ecca0b3f3b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:18 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c Sep 11 21:43:18 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:18 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c" returned: 0 in 0.461s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:18 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c Sep 11 21:43:18 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:19 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-06b3420c-59f6-4ff6-84dc-d092332f5b9c" returned: 0 in 0.333s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-06b3420c-59f6-4ff6-84dc-d092332f5b9c" released by "delete_volume" :: held 0.884s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Created reservations ['7d3c86d9-80d7-44c7-ae1e-00dc6dff470c', 'e04cb981-c08c-4e20-a191-44e5fe555d67', 'bde384c8-c222-4308-91a1-6d980b56100f', '01427569-cf0e-49ac-8b2c-d9962bd3ca28'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:19 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:19 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:19 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.425s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:19 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Deleted volume successfully. Sep 11 21:43:19 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b287f8f9-225b-4721-a980-381308824f13 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-06b3420c-59f6-4ff6-84dc-d092332f5b9c-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (edda5474-7f31-4557-b2a5-76639b74d7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bcce9b-bb7a-4e21-89cd-9575ad9d1e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bcce9b-bb7a-4e21-89cd-9575ad9d1e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105118084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8879445d-aecb-4bc1-878d-69e676f6c576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:20Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5751cc1-3ae5-4040-8cc6-c005d90cbb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5751cc1-3ae5-4040-8cc6-c005d90cbb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faab9d3-3546-435c-935d-c4a3fe60ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faab9d3-3546-435c-935d-c4a3fe60ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8879445d-aecb-4bc1-878d-69e676f6c576', 'volume_name': 'volume-8879445d-aecb-4bc1-878d-69e676f6c576', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1499ccbc-fdd7-405b-8fcf-b70b0aa08f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1499ccbc-fdd7-405b-8fcf-b70b0aa08f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7faf3761-f0dd-4125-995d-f333df328710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:20 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Volume 8879445d-aecb-4bc1-878d-69e676f6c576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8879445d-aecb-4bc1-878d-69e676f6c576', 'volume_size': 1} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105118084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8879445d-aecb-4bc1-878d-69e676f6c576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:20Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Creating volume 8879445d-aecb-4bc1-878d-69e676f6c576 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:20 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:20 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 1073741824 Sep 11 21:43:20 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:21 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 1073741824" returned: 0 in 0.528s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:21 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 Sep 11 21:43:21 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:21 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576" returned: 0 in 0.316s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:21 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7faf3761-f0dd-4125-995d-f333df328710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8879445d-aecb-4bc1-878d-69e676f6c576', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e9dceb-6644-4543-94c3-de10a1f21ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:21 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Volume volume-8879445d-aecb-4bc1-878d-69e676f6c576 (8879445d-aecb-4bc1-878d-69e676f6c576): created successfully Sep 11 21:43:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e9dceb-6644-4543-94c3-de10a1f21ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:21 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (edda5474-7f31-4557-b2a5-76639b74d7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f8acc392-a7d3-4b54-adc3-dcacf9d1494d tempest-ProjectReaderTests-1143561272 None] Created volume successfully. Sep 11 21:43:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:22 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Creating offline snapshot e5f9adc9-2f13-49b5-9267-e36fbfdf1290 of volume 8879445d-aecb-4bc1-878d-69e676f6c576 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:43:22 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d591f4c-6f77-4bde-85e5-1a410e7a711f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:22 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 Sep 11 21:43:22 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:22 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576" returned: 0 in 0.478s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:23 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 1G Sep 11 21:43:23 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:23 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 1G" returned: 0 in 0.534s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8879445d-aecb-4bc1-878d-69e676f6c576 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:23 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8879445d-aecb-4bc1-878d-69e676f6c576 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 Sep 11 21:43:23 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:23 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8879445d-aecb-4bc1-878d-69e676f6c576 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290" returned: 0 in 0.344s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:23 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 is being set with open permissions: ugo+rw Sep 11 21:43:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:23 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 Sep 11 21:43:23 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:24 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290" returned: 0 in 0.307s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:24 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=202,cinder:UPDATE=300,cinder:INSERT=73,cinder:DELETE=24 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:43:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:24 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.info Sep 11 21:43:24 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:24 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.info" returned: 0 in 0.335s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:24 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.info is being set with open permissions: ugo+rw Sep 11 21:43:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:24 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.info Sep 11 21:43:24 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:24 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.info" returned: 0 in 0.352s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:24 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e16e5c0c-e035-45ba-adfa-65aeb667d3ac tempest-ProjectReaderTests-1143561272 None] Create snapshot completed successfully Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-e5f9adc9-2f13-49b5-9267-e36fbfdf1290-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-e5f9adc9-2f13-49b5-9267-e36fbfdf1290-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-8879445d-aecb-4bc1-878d-69e676f6c576" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-8879445d-aecb-4bc1-878d-69e676f6c576" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-e5f9adc9-2f13-49b5-9267-e36fbfdf1290" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-e5f9adc9-2f13-49b5-9267-e36fbfdf1290" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Deleting offline snapshot e5f9adc9-2f13-49b5-9267-e36fbfdf1290 of volume 8879445d-aecb-4bc1-878d-69e676f6c576 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] snapshot_file for this snap is: volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5941bfa3-3491-42c1-a85e-9e97dfa5a7ab]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Flow 'volume_create_manager' (16d4a0d4-da4b-4834-9c2c-7bd1ed84db20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b06d2f2-3f9c-43ff-8fee-ae9ec56d58c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b06d2f2-3f9c-43ff-8fee-ae9ec56d58c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780bbabd-e1ba-49d4-ab53-9feb6b7ddec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b35abf0aec424b81c2698eee961803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:26Z,use_quota=True,user_id='b1574515db86448e8be58d5453f402ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fa3136-e9e1-488a-a649-468ac390a32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fa3136-e9e1-488a-a649-468ac390a32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5ebf8a-1349-4c88-a31a-4a5353f5d3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.image.glance [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Creating Keystone auth plugin from conf {{(pid=87423) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 21:43:26 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 Sep 11 21:43:26 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:26 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290" returned: 0 in 0.514s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8879445d-aecb-4bc1-878d-69e676f6c576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a21813-4922-4a81-9390-93f385c5f6fc]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5ebf8a-1349-4c88-a31a-4a5353f5d3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '780bbabd-e1ba-49d4-ab53-9feb6b7ddec8', 'volume_name': 'volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8', 'volume_size': 1, 'image_id': 'c2e51f8e-7190-4d79-a441-6a59b97551c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2e51f8e-7190-4d79-a441-6a59b97551c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '077541c91cf1e8d5e34119f9f59cef48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4b35abf0aec424b81c2698eee961803', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85fbae888add84264e98993953feb2ae5d9ce5602f79a7ab5e013ab1e2ccd29e87e26b33b8de38d0f3620e6cd4a69de2044b3f1bf31ffe04d587f5ad991975a8', 'id': 'c2e51f8e-7190-4d79-a441-6a59b97551c2', 'created_at': datetime.datetime(2026, 9, 11, 19, 43, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 43, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2e51f8e-7190-4d79-a441-6a59b97551c2/file', 'properties': {}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2cb2e3-925a-480b-960d-830083b165bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2cb2e3-925a-480b-960d-830083b165bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c444b00-83a0-4a61-a947-ea32e75be02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:26 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Volume 780bbabd-e1ba-49d4-ab53-9feb6b7ddec8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8', 'volume_size': 1, 'image_id': 'c2e51f8e-7190-4d79-a441-6a59b97551c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2e51f8e-7190-4d79-a441-6a59b97551c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '077541c91cf1e8d5e34119f9f59cef48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4b35abf0aec424b81c2698eee961803', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85fbae888add84264e98993953feb2ae5d9ce5602f79a7ab5e013ab1e2ccd29e87e26b33b8de38d0f3620e6cd4a69de2044b3f1bf31ffe04d587f5ad991975a8', 'id': 'c2e51f8e-7190-4d79-a441-6a59b97551c2', 'created_at': datetime.datetime(2026, 9, 11, 19, 43, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 43, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2e51f8e-7190-4d79-a441-6a59b97551c2/file', 'properties': {}}, 'image_service': } Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Trying to clone 780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 from image c2e51f8e-7190-4d79-a441-6a59b97551c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c2e51f8e-7190-4d79-a441-6a59b97551c2', 'metadata': {}}]). {{(pid=87423) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 21:43:26 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 Sep 11 21:43:26 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 21:43:26 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Image download 0.00 MB at 0.00 MB/s Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29e7792-a6d3-47e9-8dd2-1347a6ad8f3f]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:26 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD Sep 11 21:43:26 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:26 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576" returned: 0 in 0.487s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:27 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 Sep 11 21:43:27 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:27 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:27 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD Sep 11 21:43:27 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:27 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290" returned: 0 in 0.532s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:27 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290 Sep 11 21:43:27 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:27 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD" returned: 1 in 0.548s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Temporary image c2e51f8e-7190-4d79-a441-6a59b97551c2 is fetched for user b1574515db86448e8be58d5453f402ce. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a12e9e-db81-4f7f-b55a-82479cd24377]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:27 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576.e5f9adc9-2f13-49b5-9267-e36fbfdf1290" returned: 0 in 0.420s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:28 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD Sep 11 21:43:28 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-e5f9adc9-2f13-49b5-9267-e36fbfdf1290" released by "_delete_snapshot" :: held 2.155s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-8879445d-aecb-4bc1-878d-69e676f6c576" released by "delete_snapshot" :: held 2.190s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Created reservations ['2eae72f6-9f62-4d3f-ae68-f359e979d2f0', 'ec1ff50c-36a2-44f9-a42c-7a81cd5249ba', 'ee9a48db-f75a-4bc4-9180-be514e7b2a96', 'cad164f1-f64a-42cf-b33f-23bb6423e779'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:28 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Delete snapshot completed successfully. Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-0ad13e13-46f8-4b6c-b58d-6ac64d82f1f3 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-e5f9adc9-2f13-49b5-9267-e36fbfdf1290-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:28 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:28 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD Sep 11 21:43:28 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (0b384fb7-22b6-4aaa-a82b-5a8f007705e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12c1a0f-a861-4654-901d-ca8ea059c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12c1a0f-a861-4654-901d-ca8ea059c079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998203782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe249f1-df4d-426f-9df5-473a0c7b6cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:28Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3032dda9-7933-4305-9a6b-8039f1517dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3032dda9-7933-4305-9a6b-8039f1517dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4993e041-8b6b-4516-bbe9-aba10120f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4993e041-8b6b-4516-bbe9-aba10120f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe249f1-df4d-426f-9df5-473a0c7b6cc6', 'volume_name': 'volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e036622e-a793-4402-9654-a4164bdf4a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e036622e-a793-4402-9654-a4164bdf4a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9f0af9-1df4-49fe-9adb-b9fb18e559fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:28 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Volume 9fe249f1-df4d-426f-9df5-473a0c7b6cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6', 'volume_size': 1} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998203782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe249f1-df4d-426f-9df5-473a0c7b6cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:28Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Creating volume 9fe249f1-df4d-426f-9df5-473a0c7b6cc6 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:28 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:28 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 1073741824 Sep 11 21:43:28 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:28 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:43:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-8879445d-aecb-4bc1-878d-69e676f6c576-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-8879445d-aecb-4bc1-878d-69e676f6c576-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-8879445d-aecb-4bc1-878d-69e676f6c576" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-8879445d-aecb-4bc1-878d-69e676f6c576" acquired by "delete_volume" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:29 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 1073741824" returned: 0 in 0.573s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e242a5eb-0b42-48b2-bbb5-7d95f4c66743]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:29 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 Sep 11 21:43:29 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:29 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 Sep 11 21:43:29 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:29 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" returned: 0 in 0.269s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.795s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780bbabd-e1ba-49d4-ab53-9feb6b7ddec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b35abf0aec424b81c2698eee961803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:26Z,use_quota=True,user_id='b1574515db86448e8be58d5453f402ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Creating volume 780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:29 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:29 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 1073741824 Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9f0af9-1df4-49fe-9adb-b9fb18e559fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:29 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1c13f9-d190-4c36-979c-675175c6438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:29 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Volume volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 (9fe249f1-df4d-426f-9df5-473a0c7b6cc6): created successfully Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1c13f9-d190-4c36-979c-675175c6438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (0b384fb7-22b6-4aaa-a82b-5a8f007705e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:29 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2e0f359a-7e37-4fac-845c-cb78011ec24f tempest-ProjectMemberTests-1173642712 None] Created volume successfully. Sep 11 21:43:29 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576" returned: 0 in 0.434s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:29 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576 Sep 11 21:43:29 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:29 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-8879445d-aecb-4bc1-878d-69e676f6c576" returned: 0 in 0.285s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-8879445d-aecb-4bc1-878d-69e676f6c576" released by "delete_volume" :: held 0.802s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Created reservations ['97b90b9e-72c4-463f-9642-6794430c7d35', '71702d5d-9d53-45ba-b563-bccc4a5ac555', 'd0c6c15e-e181-42ee-8acf-2c6ab11e52e7', '6c6bb919-244e-4e0f-ab54-cf4c49f88b1e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:30 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 1073741824" returned: 0 in 0.554s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:30 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 Sep 11 21:43:30 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:30 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:30 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:30 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8" returned: 0 in 0.324s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:30 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.306s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:30 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Deleted volume successfully. Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Attempting download of c2e51f8e-7190-4d79-a441-6a59b97551c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2e51f8e-7190-4d79-a441-6a59b97551c2', 'metadata': {}}])) to volume 780bbabd-e1ba-49d4-ab53-9feb6b7ddec8. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-2c212f80-7435-4ab4-9070-7ac844790103 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-8879445d-aecb-4bc1-878d-69e676f6c576-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[246bfbdd-7559-4d00-9100-799380666785]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2e51f8e-7190-4d79-a441-6a59b97551c2_k14y1kjj {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:30 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2e51f8e-7190-4d79-a441-6a59b97551c2_k14y1kjj Sep 11 21:43:30 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (e07ac12b-54b6-4fcd-a58a-35156f324187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b129f4e6-1a17-4b67-9d3e-aa900d851f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b129f4e6-1a17-4b67-9d3e-aa900d851f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699286219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8eb2fa-a906-42a0-b45d-59d2079e1959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:31Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c2c910-1d5c-40ca-aecf-a910901b37c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c2c910-1d5c-40ca-aecf-a910901b37c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:30 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd99ba56-870a-4167-b418-f9083d71dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd99ba56-870a-4167-b418-f9083d71dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac8eb2fa-a906-42a0-b45d-59d2079e1959', 'volume_name': 'volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e659daa-11df-4a9a-9274-25a3497a2e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e659daa-11df-4a9a-9274-25a3497a2e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0dbe3c-723f-408d-b4e4-03e8bb760a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:30 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Volume ac8eb2fa-a906-42a0-b45d-59d2079e1959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959', 'volume_size': 1} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699286219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8eb2fa-a906-42a0-b45d-59d2079e1959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:31Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Creating volume ac8eb2fa-a906-42a0-b45d-59d2079e1959 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:30 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2e51f8e-7190-4d79-a441-6a59b97551c2_k14y1kjj" returned: 0 in 0.444s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2e51f8e-7190-4d79-a441-6a59b97551c2_k14y1kjj {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:31 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 1073741824 Sep 11 21:43:31 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:31 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2e51f8e-7190-4d79-a441-6a59b97551c2_k14y1kjj Sep 11 21:43:31 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:31 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2e51f8e-7190-4d79-a441-6a59b97551c2_k14y1kjj" returned: 1 in 0.405s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2e51f8e-7190-4d79-a441-6a59b97551c2_k14y1kjj' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159bcf4-d57a-4835-af1c-29fc19f286b6]: (4, 'raw') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:31 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 1073741824" returned: 0 in 0.534s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:31 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD Sep 11 21:43:31 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:31 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 Sep 11 21:43:31 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:31 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:31 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.673s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0dbe3c-723f-408d-b4e4-03e8bb760a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9939ec26-ff9b-4fda-abd6-78fdd6f90eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Creating offline snapshot 7774c483-3823-477b-9542-1179d32b55ae of volume 9fe249f1-df4d-426f-9df5-473a0c7b6cc6 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:43:31 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Volume volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 (ac8eb2fa-a906-42a0-b45d-59d2079e1959): created successfully Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9939ec26-ff9b-4fda-abd6-78fdd6f90eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (e07ac12b-54b6-4fcd-a58a-35156f324187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6b77a3-572a-4fca-96c1-17169ea4d92d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:31 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD Sep 11 21:43:31 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-98b30523-fd82-4a3f-884d-ac601222e2c2 tempest-ProjectReaderTests-1143561272 None] Created volume successfully. Sep 11 21:43:32 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 Sep 11 21:43:32 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:32 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] c2e51f8e-7190-4d79-a441-6a59b97551c2 was raw, converting to qcow2 {{(pid=87423) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:32 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 Sep 11 21:43:32 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:32 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" returned: 0 in 0.417s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:32 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae 1G Sep 11 21:43:32 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:32 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8" returned: 0 in 0.489s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c2e51f8e-7190-4d79-a441-6a59b97551c2_vi1x9tf3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:43:32 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:32 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 1G Sep 11 21:43:32 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:32 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae 1G" returned: 0 in 0.499s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:32 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae Sep 11 21:43:32 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:33 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 1G" returned: 0 in 0.414s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Downloaded image c2e51f8e-7190-4d79-a441-6a59b97551c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2e51f8e-7190-4d79-a441-6a59b97551c2', 'metadata': {}}])) to volume 780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 successfully. {{(pid=87423) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Temporary image c2e51f8e-7190-4d79-a441-6a59b97551c2 for user b1574515db86448e8be58d5453f402ce is deleted. {{(pid=87423) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.volume.volume_utils [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Marking volume 780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 as bootable. {{(pid=87423) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=231,cinder:UPDATE=300,cinder:DELETE=29,cinder:INSERT=80 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Copying metadata from image c2e51f8e-7190-4d79-a441-6a59b97551c2 to 780bbabd-e1ba-49d4-ab53-9feb6b7ddec8. {{(pid=87423) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Creating volume glance metadata for volume 780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 backed by image c2e51f8e-7190-4d79-a441-6a59b97551c2 with: {'image_id': 'c2e51f8e-7190-4d79-a441-6a59b97551c2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '077541c91cf1e8d5e34119f9f59cef48', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87423) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c444b00-83a0-4a61-a947-ea32e75be02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8', 'volume_size': 1, 'image_id': 'c2e51f8e-7190-4d79-a441-6a59b97551c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2e51f8e-7190-4d79-a441-6a59b97551c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '077541c91cf1e8d5e34119f9f59cef48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4b35abf0aec424b81c2698eee961803', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85fbae888add84264e98993953feb2ae5d9ce5602f79a7ab5e013ab1e2ccd29e87e26b33b8de38d0f3620e6cd4a69de2044b3f1bf31ffe04d587f5ad991975a8', 'id': 'c2e51f8e-7190-4d79-a441-6a59b97551c2', 'created_at': datetime.datetime(2026, 9, 11, 19, 43, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 19, 43, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2e51f8e-7190-4d79-a441-6a59b97551c2/file', 'properties': {}}, 'image_service': }' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9b89de-e96f-4b9e-bd7d-1777f1f120b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:33 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae" returned: 0 in 0.365s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:33 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae is being set with open permissions: ugo+rw Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:33 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Volume volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 (780bbabd-e1ba-49d4-ab53-9feb6b7ddec8): created successfully Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9b89de-e96f-4b9e-bd7d-1777f1f120b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Flow 'volume_create_manager' (16d4a0d4-da4b-4834-9c2c-7bd1ed84db20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:33 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae Sep 11 21:43:33 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:33 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-12aa787d-a4ba-4b00-bdb3-a2c672b7d551 tempest-VolumeImageDependencyTests-12934555 None] Created volume successfully. Sep 11 21:43:33 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae" returned: 0 in 0.271s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:33 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.info Sep 11 21:43:33 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Acquiring lock "cinder-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Lock "cinder-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Acquiring lock "cinder-quobyte-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Lock "cinder-quobyte-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0354af1-6fc8-4894-b152-93e6c09eb8bd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:33 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 Sep 11 21:43:33 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:33 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.info" returned: 0 in 0.313s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:33 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.info is being set with open permissions: ugo+rw Sep 11 21:43:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:33 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.info Sep 11 21:43:33 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:34 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8" returned: 0 in 0.420s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:34 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.info" returned: 0 in 0.315s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:34 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8 Sep 11 21:43:34 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.051s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Creating offline snapshot bbee7bb9-3b57-4425-9184-43e6d530bd5e of volume ac8eb2fa-a906-42a0-b45d-59d2079e1959 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:43:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-86b724e1-b69f-4c97-9dcc-277e66b4b037 tempest-ProjectMemberTests-1173642712 None] Create snapshot completed successfully Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6484901-e8ca-457e-83b7-a8389fe85dea]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:34 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 Sep 11 21:43:34 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-7774c483-3823-477b-9542-1179d32b55ae-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-7774c483-3823-477b-9542-1179d32b55ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-7774c483-3823-477b-9542-1179d32b55ae" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-7774c483-3823-477b-9542-1179d32b55ae" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Deleting offline snapshot 7774c483-3823-477b-9542-1179d32b55ae of volume 9fe249f1-df4d-426f-9df5-473a0c7b6cc6 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:43:34 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] snapshot_file for this snap is: volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8" returned: 0 in 0.345s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d251152e-52da-443d-90f3-7e9e29ffbb12]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Lock "cinder-quobyte-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8" released by "delete_volume" :: held 0.823s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Created reservations ['fe756c67-9c13-4582-8093-802cf1d52867', '36d9e8d1-f111-4ad2-8621-9444df485151', '5f56dd6b-8b8a-4879-ad1d-bc462b0d5181', '66079d7d-359f-4c7c-8eb3-bc99ad3feac5'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:34 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae Sep 11 21:43:34 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:34 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959" returned: 0 in 0.453s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:34 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:34 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:34 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e 1G Sep 11 21:43:34 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:35 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.396s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:35 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Deleted volume successfully. Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-3b7a08de-884d-4b38-95f6-d60381468956 tempest-VolumeImageDependencyTests-12934555 None] Lock "cinder-780bbabd-e1ba-49d4-ab53-9feb6b7ddec8-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:35 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae" returned: 0 in 0.634s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4611d5a-e5d6-421d-9738-5979f600a557]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:35 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e 1G" returned: 0 in 0.606s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:35 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 Sep 11 21:43:35 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:35 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e Sep 11 21:43:35 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:35 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" returned: 0 in 0.426s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:35 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae Sep 11 21:43:35 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:35 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e" returned: 0 in 0.397s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:35 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e is being set with open permissions: ugo+rw Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:35 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e Sep 11 21:43:35 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:35 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e" returned: 0 in 0.302s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:35 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae" returned: 0 in 0.409s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:36 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae Sep 11 21:43:36 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:36 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.info Sep 11 21:43:36 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:36 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6.7774c483-3823-477b-9542-1179d32b55ae" returned: 0 in 0.351s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:36 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.info" returned: 0 in 0.361s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:36 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.info is being set with open permissions: ugo+rw Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-7774c483-3823-477b-9542-1179d32b55ae" released by "_delete_snapshot" :: held 1.980s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" released by "delete_snapshot" :: held 2.031s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:36 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.info Sep 11 21:43:36 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Created reservations ['136eb894-dac6-4cce-b97b-6a7f5ac5fa18', '176d4c11-210a-43ec-ad39-d527bef2354c', 'b740945c-a077-4911-b097-c4fcc184aea2', '5d35bc13-c321-4f23-9504-9b98a3ca8688'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:36 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Delete snapshot completed successfully. Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a23c6b17-fc3a-464b-8e59-c27966efc32f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-7774c483-3823-477b-9542-1179d32b55ae-delete_snapshot" released by "delete_snapshot" :: held 2.254s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:36 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.info" returned: 0 in 0.317s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:36 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9af3cb97-c25b-4da3-826c-6e8ad5066df8 tempest-ProjectReaderTests-1143561272 None] Create snapshot completed successfully Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-bbee7bb9-3b57-4425-9184-43e6d530bd5e-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-bbee7bb9-3b57-4425-9184-43e6d530bd5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-ac8eb2fa-a906-42a0-b45d-59d2079e1959" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-ac8eb2fa-a906-42a0-b45d-59d2079e1959" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-bbee7bb9-3b57-4425-9184-43e6d530bd5e" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-bbee7bb9-3b57-4425-9184-43e6d530bd5e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Deleting offline snapshot bbee7bb9-3b57-4425-9184-43e6d530bd5e of volume ac8eb2fa-a906-42a0-b45d-59d2079e1959 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] snapshot_file for this snap is: volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2158870-b04b-450e-9eee-3b5362f2104e]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:37 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e Sep 11 21:43:37 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-9fe249f1-df4d-426f-9df5-473a0c7b6cc6-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Lock "cinder-9fe249f1-df4d-426f-9df5-473a0c7b6cc6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b640f7-d829-4e8e-9fac-0e0dfc6ebeb4]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:37 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e" returned: 0 in 0.467s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:43:38 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[9095f8f5-b6ac-4756-bc23-df18274d5e16]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:38 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:38 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 Sep 11 21:43:38 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:38 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" returned: 0 in 0.518s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:38 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6 Sep 11 21:43:38 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:38 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959" returned: 0 in 0.515s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:38 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e Sep 11 21:43:38 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:38 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" returned: 0 in 0.340s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-9fe249f1-df4d-426f-9df5-473a0c7b6cc6" released by "delete_volume" :: held 0.944s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Created reservations ['b8d4d18a-70ba-4b0f-b17d-f6b3d859c47c', '0a61a84a-ef25-4f19-af0c-9b088d670a80', 'd445f476-68d7-4878-87f1-b60a19324659', 'e64deac2-e3c1-4d5d-bfaf-5fd3deeea17c'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:38 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:38 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:39 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e" returned: 0 in 0.513s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:39 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e Sep 11 21:43:39 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:39 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.347s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Deleted volume successfully. Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f4652851-05b7-48d8-8bac-44bd8c9ce9eb tempest-ProjectMemberTests-1173642712 None] Lock "cinder-9fe249f1-df4d-426f-9df5-473a0c7b6cc6-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:39 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959.bbee7bb9-3b57-4425-9184-43e6d530bd5e" returned: 0 in 0.320s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-bbee7bb9-3b57-4425-9184-43e6d530bd5e" released by "_delete_snapshot" :: held 1.943s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-ac8eb2fa-a906-42a0-b45d-59d2079e1959" released by "delete_snapshot" :: held 1.973s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Created reservations ['e24e912b-05af-472f-8b8e-13c21a661e34', '4e43d743-de20-4737-9bbb-7a29c6281353', '3e570993-d1ba-4bb5-b15d-a07435e3a97b', 'b7ca8df2-eed0-4cb2-89b3-fa4535ad0c65'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:39 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Delete snapshot completed successfully. Sep 11 21:43:39 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-01d202c5-ed6f-4f2e-9bd3-0237d163eb21 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-bbee7bb9-3b57-4425-9184-43e6d530bd5e-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (60c5df47-bdae-442b-ae93-da49ba94031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a438b7b5-654d-4c00-9be4-6748113a18e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a438b7b5-654d-4c00-9be4-6748113a18e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1330273494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7299e9d6-88e4-499b-bad0-4c066a9e9c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:41Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76ce4ba-e9ba-4f5e-8690-3ea4c283073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76ce4ba-e9ba-4f5e-8690-3ea4c283073e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab30f084-7872-438e-8910-5145a721f276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab30f084-7872-438e-8910-5145a721f276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7299e9d6-88e4-499b-bad0-4c066a9e9c55', 'volume_name': 'volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8774af-e805-4ad8-ac94-0d6fdad9fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8774af-e805-4ad8-ac94-0d6fdad9fe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe2a8d4-5789-4b5c-a88a-fa6d81ac5d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:40 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Volume 7299e9d6-88e4-499b-bad0-4c066a9e9c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55', 'volume_size': 1} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1330273494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7299e9d6-88e4-499b-bad0-4c066a9e9c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:41Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Creating volume 7299e9d6-88e4-499b-bad0-4c066a9e9c55 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:40 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-ac8eb2fa-a906-42a0-b45d-59d2079e1959-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:40 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 1073741824 Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Lock "cinder-ac8eb2fa-a906-42a0-b45d-59d2079e1959-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:40 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-ac8eb2fa-a906-42a0-b45d-59d2079e1959" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-ac8eb2fa-a906-42a0-b45d-59d2079e1959" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3395dc68-8351-4e96-97c8-26d4fd309540]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:41 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 Sep 11 21:43:41 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:41 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 1073741824" returned: 0 in 0.576s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:41 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959" returned: 0 in 0.449s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:41 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959 Sep 11 21:43:41 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:41 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 Sep 11 21:43:41 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:41 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55" returned: 0 in 0.286s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe2a8d4-5789-4b5c-a88a-fa6d81ac5d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11065f4c-9e46-46eb-ae91-4a6a8c3ec093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:41 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Volume volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 (7299e9d6-88e4-499b-bad0-4c066a9e9c55): created successfully Sep 11 21:43:41 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11065f4c-9e46-46eb-ae91-4a6a8c3ec093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (60c5df47-bdae-442b-ae93-da49ba94031d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ac8eb2fa-a906-42a0-b45d-59d2079e1959" returned: 0 in 0.387s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-77ac511a-8ba6-416e-b090-b3acfb1ac4ea tempest-ProjectMemberTests-1173642712 None] Created volume successfully. Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-ac8eb2fa-a906-42a0-b45d-59d2079e1959" released by "delete_volume" :: held 0.922s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Created reservations ['29f5bf1d-a282-448d-b9e9-3dd93cc5112f', '2720e3f0-6bbe-469a-a4d4-b13f17e6cf97', 'a0cbba47-ae1b-4baf-951c-576c93284029', 'bb652da6-381b-4e2f-8c7d-b72c69fd1d3c'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:41 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:41 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:42 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.257s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:42 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:42 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Deleted volume successfully. Sep 11 21:43:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16306553-babf-41a5-96c5-ed03f2a0352f tempest-ProjectReaderTests-1143561272 None] Lock "cinder-ac8eb2fa-a906-42a0-b45d-59d2079e1959-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:42 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Creating offline snapshot e8da28c6-3bbe-43b0-978c-9ac5089e3cde of volume 7299e9d6-88e4-499b-bad0-4c066a9e9c55 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:43:42 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfefec7-0d12-4653-803f-64e1809fb56d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:43 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 Sep 11 21:43:43 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:43 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55" returned: 0 in 0.416s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:43 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde 1G Sep 11 21:43:43 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (809d817b-dd4d-4eec-b78a-ebe96331477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18486f3-3b68-4d61-b9e6-6b107a35ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18486f3-3b68-4d61-b9e6-6b107a35ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660646229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0e892c-4adf-461d-8045-f256e81e391c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:44Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b52e4b1-7e64-4e96-878b-ccb5cd4a1b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b52e4b1-7e64-4e96-878b-ccb5cd4a1b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e750ea33-9de2-408a-9ada-825c06d65cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e750ea33-9de2-408a-9ada-825c06d65cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff0e892c-4adf-461d-8045-f256e81e391c', 'volume_name': 'volume-ff0e892c-4adf-461d-8045-f256e81e391c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c865148d-2b38-4960-b5ee-4c2bc3134103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c865148d-2b38-4960-b5ee-4c2bc3134103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41faea96-3a8e-4692-88d6-c98fa59bdd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:43 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Volume ff0e892c-4adf-461d-8045-f256e81e391c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff0e892c-4adf-461d-8045-f256e81e391c', 'volume_size': 1} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:43 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde 1G" returned: 0 in 0.547s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:43 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde Sep 11 21:43:43 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:44 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde" returned: 0 in 0.350s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:44 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde is being set with open permissions: ugo+rw Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:44 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde Sep 11 21:43:44 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Flow 'volume_create_manager' (0cf6e889-11ce-480a-b406-da6750e70ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7e96a8-3e62-4345-bf05-ba28f97e96bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7e96a8-3e62-4345-bf05-ba28f97e96bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516413549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb01c946-c335-402f-a695-8c651f467f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908db284b15d4da9bb77baac9cd36ccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:44Z,use_quota=True,user_id='2d5009532d0f4892ab4d8f9b45ef6081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bef04ae-096d-426a-8c50-bf6f041c3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bef04ae-096d-426a-8c50-bf6f041c3cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46081688-6d99-4100-b599-c06dea010e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46081688-6d99-4100-b599-c06dea010e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb01c946-c335-402f-a695-8c651f467f8d', 'volume_name': 'volume-bb01c946-c335-402f-a695-8c651f467f8d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625c4252-fa15-4719-b647-3e7cc839a3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625c4252-fa15-4719-b647-3e7cc839a3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d4ea34-2816-4831-a29f-97b999fa9c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:44 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Volume bb01c946-c335-402f-a695-8c651f467f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb01c946-c335-402f-a695-8c651f467f8d', 'volume_size': 1} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:44 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde" returned: 0 in 0.292s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:44 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.info Sep 11 21:43:44 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:44 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.info" returned: 0 in 0.272s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:44 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.info is being set with open permissions: ugo+rw Sep 11 21:43:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:44 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.info Sep 11 21:43:44 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:45 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.info" returned: 0 in 0.285s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.418s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660646229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0e892c-4adf-461d-8045-f256e81e391c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:44Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Creating volume ff0e892c-4adf-461d-8045-f256e81e391c {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:45 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:45 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c 1073741824 Sep 11 21:43:45 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:45 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-cd539ca8-54d7-474e-ab5e-aff7c16f5511 tempest-ProjectMemberTests-1173642712 None] Create snapshot completed successfully Sep 11 21:43:45 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c 1073741824" returned: 0 in 0.451s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:45 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c Sep 11 21:43:45 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:45 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c" returned: 0 in 0.275s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516413549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb01c946-c335-402f-a695-8c651f467f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908db284b15d4da9bb77baac9cd36ccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:44Z,use_quota=True,user_id='2d5009532d0f4892ab4d8f9b45ef6081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Creating volume bb01c946-c335-402f-a695-8c651f467f8d {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:45 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:45 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d 1073741824 Sep 11 21:43:45 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41faea96-3a8e-4692-88d6-c98fa59bdd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff0e892c-4adf-461d-8045-f256e81e391c', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:45 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372e2fb0-9a79-4767-83a7-98170c810208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:46 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Volume volume-ff0e892c-4adf-461d-8045-f256e81e391c (ff0e892c-4adf-461d-8045-f256e81e391c): created successfully Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372e2fb0-9a79-4767-83a7-98170c810208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (809d817b-dd4d-4eec-b78a-ebe96331477d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-e8da28c6-3bbe-43b0-978c-9ac5089e3cde-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-de3a6b80-a594-4cc7-8dbd-4a0ea23a1fc7 tempest-ProjectReaderTests-1143561272 None] Created volume successfully. Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-e8da28c6-3bbe-43b0-978c-9ac5089e3cde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-7299e9d6-88e4-499b-bad0-4c066a9e9c55" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-7299e9d6-88e4-499b-bad0-4c066a9e9c55" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-e8da28c6-3bbe-43b0-978c-9ac5089e3cde" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-e8da28c6-3bbe-43b0-978c-9ac5089e3cde" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Deleting offline snapshot e8da28c6-3bbe-43b0-978c-9ac5089e3cde of volume 7299e9d6-88e4-499b-bad0-4c066a9e9c55 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] snapshot_file for this snap is: volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1444785d-9841-4f94-ac18-52319e5aafd6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:46 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde Sep 11 21:43:46 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:46 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d 1073741824" returned: 0 in 0.470s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:46 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d Sep 11 21:43:46 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:46 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde" returned: 0 in 0.410s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65dd3e1-915c-4b9f-aab2-9cec1a3ae413]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:46 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 Sep 11 21:43:46 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:46 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d" returned: 0 in 0.279s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d4ea34-2816-4831-a29f-97b999fa9c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb01c946-c335-402f-a695-8c651f467f8d', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f6c390-85ed-4025-ac15-cc53bd1c022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:46 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Volume volume-bb01c946-c335-402f-a695-8c651f467f8d (bb01c946-c335-402f-a695-8c651f467f8d): created successfully Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f6c390-85ed-4025-ac15-cc53bd1c022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Flow 'volume_create_manager' (0cf6e889-11ce-480a-b406-da6750e70ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:46 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3bb01961-03a8-4d02-b6a9-1c1a5bba0ddf tempest-ProjectReaderTests-573287655 None] Created volume successfully. Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:46 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Creating offline snapshot 2f316508-fae5-4731-af54-b7552f032adc of volume ff0e892c-4adf-461d-8045-f256e81e391c {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02ab45c-0aef-4e10-8dc8-16ba582e821b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:47 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55" returned: 0 in 0.460s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:47 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde Sep 11 21:43:47 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:47 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c Sep 11 21:43:47 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:47 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c" returned: 0 in 0.406s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:47 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde" returned: 0 in 0.391s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:47 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc 1G Sep 11 21:43:47 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:47 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde Sep 11 21:43:47 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:47 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55.e8da28c6-3bbe-43b0-978c-9ac5089e3cde" returned: 0 in 0.346s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Acquiring lock "cinder-bb01c946-c335-402f-a695-8c651f467f8d-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-e8da28c6-3bbe-43b0-978c-9ac5089e3cde" released by "_delete_snapshot" :: held 1.757s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Lock "cinder-bb01c946-c335-402f-a695-8c651f467f8d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-7299e9d6-88e4-499b-bad0-4c066a9e9c55" released by "delete_snapshot" :: held 1.789s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:47 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Acquiring lock "cinder-quobyte-bb01c946-c335-402f-a695-8c651f467f8d" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc 1G" returned: 0 in 0.516s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff0e892c-4adf-461d-8045-f256e81e391c -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Lock "cinder-quobyte-bb01c946-c335-402f-a695-8c651f467f8d" acquired by "delete_volume" :: waited 0.037s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:47 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff0e892c-4adf-461d-8045-f256e81e391c -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc Sep 11 21:43:47 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cb2c7e-f836-4993-8b4d-3971eaf9c712]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:47 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Created reservations ['85fb402e-62cd-4cf6-a411-8319d9de809f', 'c2563970-a524-49bd-afc9-05118d3a14f3', '9219d0b8-c2ba-4a4c-bd83-548132abd02e', '91a1cfdc-1013-422a-ad00-c89de45d1a6d'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:48 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Delete snapshot completed successfully. Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8bb1dc98-dd7d-4e30-b3e2-ad33e630274b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-e8da28c6-3bbe-43b0-978c-9ac5089e3cde-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:48 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d Sep 11 21:43:48 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:48 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-7299e9d6-88e4-499b-bad0-4c066a9e9c55-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff0e892c-4adf-461d-8045-f256e81e391c -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc" returned: 0 in 0.340s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:48 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc is being set with open permissions: ugo+rw Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:48 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc Sep 11 21:43:48 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-7299e9d6-88e4-499b-bad0-4c066a9e9c55-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-7299e9d6-88e4-499b-bad0-4c066a9e9c55" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-7299e9d6-88e4-499b-bad0-4c066a9e9c55" acquired by "delete_volume" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:48 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d" returned: 0 in 0.424s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc69729a-be1d-4668-ad14-dd7a0a8e554c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:48 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d Sep 11 21:43:48 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:48 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 Sep 11 21:43:48 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:48 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc" returned: 0 in 0.320s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:48 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.info Sep 11 21:43:48 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:48 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-bb01c946-c335-402f-a695-8c651f467f8d" returned: 0 in 0.274s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Lock "cinder-quobyte-bb01c946-c335-402f-a695-8c651f467f8d" released by "delete_volume" :: held 0.750s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Created reservations ['627dacec-04dd-430a-aff1-23fbc1f1330f', 'c6368b05-feb9-4697-a8ba-fc7f1fc726d8', 'c0e4f527-ec34-4346-a1af-6730a7dc45ff', '995faa3b-8119-498b-8d5f-21da35acb5f4'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:48 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55" returned: 0 in 0.458s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:48 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:48 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:48 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:48 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55 Sep 11 21:43:48 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:49 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.info" returned: 0 in 0.400s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:49 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.info is being set with open permissions: ugo+rw Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:49 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.info Sep 11 21:43:49 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:49 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.357s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:49 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7299e9d6-88e4-499b-bad0-4c066a9e9c55" returned: 0 in 0.349s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Deleted volume successfully. Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-7299e9d6-88e4-499b-bad0-4c066a9e9c55" released by "delete_volume" :: held 0.912s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b4d3c8f2-6844-421b-86c5-9db63420587a tempest-ProjectReaderTests-573287655 None] Lock "cinder-bb01c946-c335-402f-a695-8c651f467f8d-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:49 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.info" returned: 0 in 0.332s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Created reservations ['c3681c31-95ee-489e-b530-fbcf28ca7762', 'd9831ef4-d531-4af0-a8d0-12863c8ed339', '417b106a-6b9d-4343-abd8-a8202daa5afe', '3e9bd695-4d71-4c43-9724-1b6bb68d0e97'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-90ed795f-f136-43c0-b623-b0ee63067410 tempest-ProjectReaderTests-1143561272 None] Create snapshot completed successfully Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:49 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:49 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Flow 'volume_create_manager' (0c6e4de4-0e2b-41b6-897b-8cc441de048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e91c33-9462-4861-8855-b9733803576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:49 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e91c33-9462-4861-8855-b9733803576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959752286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3115926-3fa0-493e-8bf2-1bcd1800263f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908db284b15d4da9bb77baac9cd36ccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:50Z,use_quota=True,user_id='2d5009532d0f4892ab4d8f9b45ef6081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5965d192-c451-4ff2-9522-2ad16f5382c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5965d192-c451-4ff2-9522-2ad16f5382c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443dc8d7-6d09-44fc-bc0f-a98b68e00c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443dc8d7-6d09-44fc-bc0f-a98b68e00c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3115926-3fa0-493e-8bf2-1bcd1800263f', 'volume_name': 'volume-c3115926-3fa0-493e-8bf2-1bcd1800263f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d350281-8bcd-415e-ab48-f910de77c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d350281-8bcd-415e-ab48-f910de77c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae810c5-8b25-4271-82c0-55bd32e14ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:49 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Volume c3115926-3fa0-493e-8bf2-1bcd1800263f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3115926-3fa0-493e-8bf2-1bcd1800263f', 'volume_size': 1} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959752286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3115926-3fa0-493e-8bf2-1bcd1800263f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908db284b15d4da9bb77baac9cd36ccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:50Z,use_quota=True,user_id='2d5009532d0f4892ab4d8f9b45ef6081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Creating volume c3115926-3fa0-493e-8bf2-1bcd1800263f {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:49 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.393s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:49 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Deleted volume successfully. Sep 11 21:43:49 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f 1073741824 Sep 11 21:43:49 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:49 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-946775a9-56af-4758-9ede-4e83a9dd9d08 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-7299e9d6-88e4-499b-bad0-4c066a9e9c55-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-2f316508-fae5-4731-af54-b7552f032adc-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Lock "cinder-2f316508-fae5-4731-af54-b7552f032adc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-ff0e892c-4adf-461d-8045-f256e81e391c" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-ff0e892c-4adf-461d-8045-f256e81e391c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-2f316508-fae5-4731-af54-b7552f032adc" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (56b08722-094b-4cc5-b5e5-1ad78d67b71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccaef4c-81f5-43f4-ba43-e050b64554cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-2f316508-fae5-4731-af54-b7552f032adc" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Deleting offline snapshot 2f316508-fae5-4731-af54-b7552f032adc of volume ff0e892c-4adf-461d-8045-f256e81e391c {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] snapshot_file for this snap is: volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4054302-083f-4886-94b0-425bd849df0d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccaef4c-81f5-43f4-ba43-e050b64554cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416111517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cfd76c-6ceb-4706-9e2c-83e0546cf697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:50Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1180bae-8021-44d7-abfc-f0ad807ed747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1180bae-8021-44d7-abfc-f0ad807ed747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca80b0d-fe99-40ff-9604-9c3589af7775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca80b0d-fe99-40ff-9604-9c3589af7775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90cfd76c-6ceb-4706-9e2c-83e0546cf697', 'volume_name': 'volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b9d8b8-9f3f-44c8-b2f5-5f8123bd4100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b9d8b8-9f3f-44c8-b2f5-5f8123bd4100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bbdfcd-45ef-4fad-8632-754ebd63a180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Volume 90cfd76c-6ceb-4706-9e2c-83e0546cf697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697', 'volume_size': 1} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:50 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc Sep 11 21:43:50 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:50 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f 1073741824" returned: 0 in 0.525s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:50 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f Sep 11 21:43:50 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:50 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc" returned: 0 in 0.400s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff0e892c-4adf-461d-8045-f256e81e391c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fc9794-97fb-44ba-8906-acd0b2ffc8be]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:50 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f" returned: 0 in 0.304s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416111517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cfd76c-6ceb-4706-9e2c-83e0546cf697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:50Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Creating volume 90cfd76c-6ceb-4706-9e2c-83e0546cf697 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:50 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae810c5-8b25-4271-82c0-55bd32e14ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3115926-3fa0-493e-8bf2-1bcd1800263f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:50 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 1073741824 Sep 11 21:43:50 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3156168-3367-4766-b8ab-912f4d97e396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:50 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Volume volume-c3115926-3fa0-493e-8bf2-1bcd1800263f (c3115926-3fa0-493e-8bf2-1bcd1800263f): created successfully Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3156168-3367-4766-b8ab-912f4d97e396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:50 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Flow 'volume_create_manager' (0c6e4de4-0e2b-41b6-897b-8cc441de048a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:50 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c Sep 11 21:43:50 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:50 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f920ffe4-3911-429c-92bc-2e5d0e5a4cd7 tempest-ProjectReaderTests-573287655 None] Created volume successfully. Sep 11 21:43:51 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c" returned: 0 in 0.515s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:51 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc Sep 11 21:43:51 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:51 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 1073741824" returned: 0 in 0.571s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:51 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 Sep 11 21:43:51 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:51 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc" returned: 0 in 0.371s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:51 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc Sep 11 21:43:51 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:51 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697" returned: 0 in 0.323s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bbdfcd-45ef-4fad-8632-754ebd63a180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8baf2e-64f8-4faa-a4d0-3955b68162ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:51 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Volume volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 (90cfd76c-6ceb-4706-9e2c-83e0546cf697): created successfully Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8baf2e-64f8-4faa-a4d0-3955b68162ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (56b08722-094b-4cc5-b5e5-1ad78d67b71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:51 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c407608c-779e-4245-bdd6-e4da5181c16e tempest-ProjectMemberTests-1173642712 None] Created volume successfully. Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Acquiring lock "cinder-c3115926-3fa0-493e-8bf2-1bcd1800263f-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Lock "cinder-c3115926-3fa0-493e-8bf2-1bcd1800263f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:51 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c.2f316508-fae5-4731-af54-b7552f032adc" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Acquiring lock "cinder-quobyte-c3115926-3fa0-493e-8bf2-1bcd1800263f" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-2f316508-fae5-4731-af54-b7552f032adc" released by "_delete_snapshot" :: held 1.695s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-ff0e892c-4adf-461d-8045-f256e81e391c" released by "delete_snapshot" :: held 1.759s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:51 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Lock "cinder-quobyte-c3115926-3fa0-493e-8bf2-1bcd1800263f" acquired by "delete_volume" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e2a355-946d-41ab-ab71-4c73eb29d788]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Created reservations ['11e4a593-e13f-424c-93d9-8770722a6072', '1ff713e3-1d3a-4c7d-b037-3fbb081c7841', 'a3c51e2d-7049-4b7f-8261-1a228fbe3ea1', '6ab80457-a608-4b8d-b6f3-f82e6db34200'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:52 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Delete snapshot completed successfully. Sep 11 21:43:52 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f Sep 11 21:43:52 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-78c9c112-1401-4c9f-9bad-589f59c9ce5e tempest-ProjectReaderTests-1143561272 None] Lock "cinder-2f316508-fae5-4731-af54-b7552f032adc-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-ff0e892c-4adf-461d-8045-f256e81e391c-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-ff0e892c-4adf-461d-8045-f256e81e391c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-ff0e892c-4adf-461d-8045-f256e81e391c" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-ff0e892c-4adf-461d-8045-f256e81e391c" acquired by "delete_volume" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:52 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f" returned: 0 in 0.521s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cacb4b-1c91-448e-938a-953c0e4dd172]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:52 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f Sep 11 21:43:52 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Creating offline snapshot 444ac20d-4d5d-4ff9-b985-320556cb4933 of volume 90cfd76c-6ceb-4706-9e2c-83e0546cf697 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[0185dc60-d723-444b-a0f1-afdc7da2d23f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:52 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c Sep 11 21:43:52 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:52 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 Sep 11 21:43:52 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:52 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-c3115926-3fa0-493e-8bf2-1bcd1800263f" returned: 0 in 0.333s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:52 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Lock "cinder-quobyte-c3115926-3fa0-493e-8bf2-1bcd1800263f" released by "delete_volume" :: held 0.905s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Created reservations ['2a1b0015-5a9f-4108-9ba5-77aeb0ad422a', 'c28067be-2cef-4cdb-b99e-4d4e04288c30', '02f37493-d792-4148-8f4b-2f3aa4a47f84', '80f96fb6-38ce-4641-8f9d-0a15063fa43f'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:53 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c" returned: 0 in 0.468s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:53 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c Sep 11 21:43:53 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:53 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697" returned: 0 in 0.490s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:53 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 1G Sep 11 21:43:53 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:53 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:53 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:53 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ff0e892c-4adf-461d-8045-f256e81e391c" returned: 0 in 0.320s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-ff0e892c-4adf-461d-8045-f256e81e391c" released by "delete_volume" :: held 0.902s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:53 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.312s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:53 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Deleted volume successfully. Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Created reservations ['f3e99d9b-acb5-4e2c-8b57-b2b383aa6110', 'ac4c916b-6fef-498f-9369-6b53514f461e', '33c422b2-7758-444e-b4bc-5a5b1bca9589', '3a820dcd-5b8e-4bb5-b65d-143a86f15013'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d8e4a75e-ff24-47d5-8c03-11d2c1863bcc tempest-ProjectReaderTests-573287655 None] Lock "cinder-c3115926-3fa0-493e-8bf2-1bcd1800263f-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:53 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:53 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:53 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 1G" returned: 0 in 0.545s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:53 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 Sep 11 21:43:53 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:53 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.251s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:53 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Deleted volume successfully. Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-4d98a24b-cd99-4291-b5f0-ff5bc0980960 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-ff0e892c-4adf-461d-8045-f256e81e391c-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:53 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933" returned: 0 in 0.294s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:53 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 is being set with open permissions: ugo+rw Sep 11 21:43:53 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:53 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 Sep 11 21:43:53 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:54 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933" returned: 0 in 0.254s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:54 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.info Sep 11 21:43:54 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:54 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.info" returned: 0 in 0.269s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:54 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.info is being set with open permissions: ugo+rw Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:54 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.info Sep 11 21:43:54 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Flow 'volume_create_manager' (d3cae367-c31a-427c-b64e-44a2e7f1d7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967d202-dd09-4ba4-ba51-684f6896cf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967d202-dd09-4ba4-ba51-684f6896cf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389130997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ef5828-25eb-4022-9730-fc6b0efa96a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908db284b15d4da9bb77baac9cd36ccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:55Z,use_quota=True,user_id='2d5009532d0f4892ab4d8f9b45ef6081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81933e3-db3f-46b9-a72f-b6e829e2141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81933e3-db3f-46b9-a72f-b6e829e2141a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7f08be-221b-4bfe-8ea6-d0e823e37269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7f08be-221b-4bfe-8ea6-d0e823e37269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ef5828-25eb-4022-9730-fc6b0efa96a8', 'volume_name': 'volume-69ef5828-25eb-4022-9730-fc6b0efa96a8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761bce34-adad-4f18-b322-5fb2fbdbd94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761bce34-adad-4f18-b322-5fb2fbdbd94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d17e11-9b4d-47a3-a767-d97a15e9d4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:54 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Volume 69ef5828-25eb-4022-9730-fc6b0efa96a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ef5828-25eb-4022-9730-fc6b0efa96a8', 'volume_size': 1} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:54 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.info" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389130997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ef5828-25eb-4022-9730-fc6b0efa96a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908db284b15d4da9bb77baac9cd36ccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:55Z,use_quota=True,user_id='2d5009532d0f4892ab4d8f9b45ef6081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Creating volume 69ef5828-25eb-4022-9730-fc6b0efa96a8 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:54 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:54 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:54 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 1073741824 Sep 11 21:43:54 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:54 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-82ef08cc-7b3c-437b-825f-a435dab130c2 tempest-ProjectMemberTests-1173642712 None] Create snapshot completed successfully Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (2eb3dccd-351e-4ff3-990c-87118b44874a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782c1610-e1f6-426b-899d-97ba2b597c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782c1610-e1f6-426b-899d-97ba2b597c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527322532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4030d70-44f9-4151-8352-05df023f0029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:55Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf8e6eb-ac4b-457d-8316-62d59c25f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf8e6eb-ac4b-457d-8316-62d59c25f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1c4b23-e3fb-416f-aa11-2e487799cec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1c4b23-e3fb-416f-aa11-2e487799cec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4030d70-44f9-4151-8352-05df023f0029', 'volume_name': 'volume-e4030d70-44f9-4151-8352-05df023f0029', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6b2d1f-bf7f-41f1-b2e4-568afaa1609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6b2d1f-bf7f-41f1-b2e4-568afaa1609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30502818-d5ac-4920-b9ee-0d0f27db7a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:55 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Volume e4030d70-44f9-4151-8352-05df023f0029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4030d70-44f9-4151-8352-05df023f0029', 'volume_size': 1} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:55 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 1073741824" returned: 0 in 0.438s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:55 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 Sep 11 21:43:55 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:55 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8" returned: 0 in 0.242s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.335s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527322532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4030d70-44f9-4151-8352-05df023f0029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571db6f7b7c4381bf9f11682568a8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:55Z,use_quota=True,user_id='7815088c34074157aafeba97e2f6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Creating volume e4030d70-44f9-4151-8352-05df023f0029 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:55 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:55 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 1073741824 Sep 11 21:43:55 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d17e11-9b4d-47a3-a767-d97a15e9d4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ef5828-25eb-4022-9730-fc6b0efa96a8', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e65b22-7879-46b3-ad56-1bcd5fde4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:55 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Volume volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 (69ef5828-25eb-4022-9730-fc6b0efa96a8): created successfully Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e65b22-7879-46b3-ad56-1bcd5fde4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Flow 'volume_create_manager' (d3cae367-c31a-427c-b64e-44a2e7f1d7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:55 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6f6cd44f-39d6-455b-ab49-93f393d8532e tempest-ProjectReaderTests-573287655 None] Created volume successfully. Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-444ac20d-4d5d-4ff9-b985-320556cb4933-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-444ac20d-4d5d-4ff9-b985-320556cb4933-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-90cfd76c-6ceb-4706-9e2c-83e0546cf697" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-90cfd76c-6ceb-4706-9e2c-83e0546cf697" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-444ac20d-4d5d-4ff9-b985-320556cb4933" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-444ac20d-4d5d-4ff9-b985-320556cb4933" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Deleting offline snapshot 444ac20d-4d5d-4ff9-b985-320556cb4933 of volume 90cfd76c-6ceb-4706-9e2c-83e0546cf697 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] snapshot_file for this snap is: volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8810c3c6-ed57-4d64-9ab1-b4f94f65a744]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:55 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:55 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 Sep 11 21:43:55 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:56 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 1073741824" returned: 0 in 0.462s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:56 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 Sep 11 21:43:56 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:56 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933" returned: 0 in 0.389s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[029472d2-70f2-4c2e-a1f1-a119152db458]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:56 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029" returned: 0 in 0.243s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30502818-d5ac-4920-b9ee-0d0f27db7a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4030d70-44f9-4151-8352-05df023f0029', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15df0e04-11f0-4454-942f-902436fdc8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:56 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Volume volume-e4030d70-44f9-4151-8352-05df023f0029 (e4030d70-44f9-4151-8352-05df023f0029): created successfully Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15df0e04-11f0-4454-942f-902436fdc8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Flow 'volume_create_manager' (2eb3dccd-351e-4ff3-990c-87118b44874a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:56 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 Sep 11 21:43:56 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:56 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-9fa5c563-2cf4-494f-85ce-5828df9ac48b tempest-ProjectReaderTests-1143561272 None] Created volume successfully. Sep 11 21:43:56 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697" returned: 0 in 0.349s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:56 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 Sep 11 21:43:56 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Acquiring lock "cinder-69ef5828-25eb-4022-9730-fc6b0efa96a8-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Lock "cinder-69ef5828-25eb-4022-9730-fc6b0efa96a8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Acquiring lock "cinder-quobyte-69ef5828-25eb-4022-9730-fc6b0efa96a8" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Lock "cinder-quobyte-69ef5828-25eb-4022-9730-fc6b0efa96a8" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dfa153-2137-4d5e-a10b-134f021512ee]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:56 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933" returned: 0 in 0.344s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:56 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:56 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 Sep 11 21:43:56 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:56 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933 Sep 11 21:43:56 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:57 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697.444ac20d-4d5d-4ff9-b985-320556cb4933" returned: 0 in 0.245s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:57 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8" returned: 0 in 0.371s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-444ac20d-4d5d-4ff9-b985-320556cb4933" released by "_delete_snapshot" :: held 1.432s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-90cfd76c-6ceb-4706-9e2c-83e0546cf697" released by "delete_snapshot" :: held 1.458s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:57 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8 Sep 11 21:43:57 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Created reservations ['b47b2c34-7e53-4391-a9cd-e9f3c72dae52', '0c1823ca-f024-431b-865e-b214fde0e9af', 'e5fe1130-1b2c-4574-bf96-96d93fe6279d', '0618d089-6f57-40ea-9eda-8060202d4f1c'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Creating offline snapshot 16fb6d0f-65de-475d-b5c4-852c42de6e44 of volume e4030d70-44f9-4151-8352-05df023f0029 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:43:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Delete snapshot completed successfully. Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fe7b8d-d7df-46e6-b6d2-380df1c69591]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-ee04efcd-1437-4faf-91da-864006461925 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-444ac20d-4d5d-4ff9-b985-320556cb4933-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:57 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-69ef5828-25eb-4022-9730-fc6b0efa96a8" returned: 0 in 0.258s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Lock "cinder-quobyte-69ef5828-25eb-4022-9730-fc6b0efa96a8" released by "delete_volume" :: held 0.668s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:57 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 Sep 11 21:43:57 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Created reservations ['5620764d-de4e-4e85-a993-4964d827be5f', '6b9ec845-1e98-4809-92d6-31a60138d434', '55ec75d4-42db-410a-b7c2-e3a30f54ea0e', '6124aa1b-825c-4ddb-81df-274988a3c897'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:57 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:57 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:57 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029" returned: 0 in 0.366s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:57 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 1G Sep 11 21:43:57 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:57 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.275s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:57 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Deleted volume successfully. Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-90cfd76c-6ceb-4706-9e2c-83e0546cf697-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-df7b6150-772c-44b9-b4ca-c79fb0731ac6 tempest-ProjectReaderTests-573287655 None] Lock "cinder-69ef5828-25eb-4022-9730-fc6b0efa96a8-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:57 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-90cfd76c-6ceb-4706-9e2c-83e0546cf697-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-90cfd76c-6ceb-4706-9e2c-83e0546cf697" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-90cfd76c-6ceb-4706-9e2c-83e0546cf697" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d8f520-8b91-4244-a6f9-13e441f1f516]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:58 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 Sep 11 21:43:58 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:58 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 1G" returned: 0 in 0.537s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4030d70-44f9-4151-8352-05df023f0029 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:58 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4030d70-44f9-4151-8352-05df023f0029 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 Sep 11 21:43:58 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Flow 'volume_create_manager' (bda2793f-b8c7-4151-adc7-c85bde7373e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488d3fca-edee-4c62-acaf-78dcaef6647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488d3fca-edee-4c62-acaf-78dcaef6647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223282146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708c8340-3938-4ea5-98d8-e2cb43798a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908db284b15d4da9bb77baac9cd36ccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:58Z,use_quota=True,user_id='2d5009532d0f4892ab4d8f9b45ef6081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db5236a-74b1-4185-a82a-54235777dff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db5236a-74b1-4185-a82a-54235777dff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:58 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45707aa2-3e20-4e71-9c1b-43dc061f3455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45707aa2-3e20-4e71-9c1b-43dc061f3455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708c8340-3938-4ea5-98d8-e2cb43798a67', 'volume_name': 'volume-708c8340-3938-4ea5-98d8-e2cb43798a67', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d2a988-1e02-4a30-a9bb-72ba30fd69d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d2a988-1e02-4a30-a9bb-72ba30fd69d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ffe382-01f2-4858-8a67-a9a57e4aa968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:58 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Volume 708c8340-3938-4ea5-98d8-e2cb43798a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708c8340-3938-4ea5-98d8-e2cb43798a67', 'volume_size': 1} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697" returned: 0 in 0.474s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:58 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697 Sep 11 21:43:58 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:58 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4030d70-44f9-4151-8352-05df023f0029 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44" returned: 0 in 0.310s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:58 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 is being set with open permissions: ugo+rw Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:58 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 Sep 11 21:43:58 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:58 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-90cfd76c-6ceb-4706-9e2c-83e0546cf697" returned: 0 in 0.246s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-90cfd76c-6ceb-4706-9e2c-83e0546cf697" released by "delete_volume" :: held 0.791s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Created reservations ['35e3757c-a048-4f99-bb5b-8ab01c133a6e', '9620f9c6-37a0-4984-b764-83c5558ea852', '4e9d3d9d-5eb1-4340-8cf9-3f53a8673488', '5b906e06-9721-427d-97f5-37a6f9cf9e3e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:43:58 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44" returned: 0 in 0.260s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:58 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:58 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.info Sep 11 21:43:58 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:58 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:43:58 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:59 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.info" returned: 0 in 0.254s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:59 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.info is being set with open permissions: ugo+rw Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:59 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.252s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:43:59 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.info Sep 11 21:43:59 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Deleted volume successfully. Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cffb208-67c8-41f4-841a-e77792fef8a0 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-90cfd76c-6ceb-4706-9e2c-83e0546cf697-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:43:59 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.info" returned: 0 in 0.281s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.957s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223282146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708c8340-3938-4ea5-98d8-e2cb43798a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908db284b15d4da9bb77baac9cd36ccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:43:58Z,use_quota=True,user_id='2d5009532d0f4892ab4d8f9b45ef6081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Creating volume 708c8340-3938-4ea5-98d8-e2cb43798a67 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:43:59 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:59 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67 1073741824 Sep 11 21:43:59 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:43:59 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-337f58fd-3f76-4e2e-a30f-b967afbf7481 tempest-ProjectReaderTests-1143561272 None] Create snapshot completed successfully Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (11681d55-6438-42dc-8a1b-03636d4e94ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a662b0d-04bd-4ba7-8c9a-8263a497626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a662b0d-04bd-4ba7-8c9a-8263a497626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43827652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:00Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7afcc75-528d-4067-938d-c9ec8150ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7afcc75-528d-4067-938d-c9ec8150ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e33464a-8ec1-41fc-8fab-67822e7fca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e33464a-8ec1-41fc-8fab-67822e7fca3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6', 'volume_name': 'volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6532cfbf-3e94-4ab7-9063-47ed14f263ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6532cfbf-3e94-4ab7-9063-47ed14f263ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9eadab6-e83a-4f15-8ab9-fe981d4b0ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:43:59 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Volume 64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6', 'volume_size': 1} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:43:59 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67 1073741824" returned: 0 in 0.409s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:43:59 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:43:59 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67 Sep 11 21:43:59 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:00 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67" returned: 0 in 0.239s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.523s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43827652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:00Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Creating volume 64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:44:00 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ffe382-01f2-4858-8a67-a9a57e4aa968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708c8340-3938-4ea5-98d8-e2cb43798a67', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:00 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 1073741824 Sep 11 21:44:00 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282ff0b6-78e0-41cf-aaee-47592402508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:00 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Volume volume-708c8340-3938-4ea5-98d8-e2cb43798a67 (708c8340-3938-4ea5-98d8-e2cb43798a67): created successfully Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282ff0b6-78e0-41cf-aaee-47592402508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Flow 'volume_create_manager' (bda2793f-b8c7-4151-adc7-c85bde7373e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:00 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-38ca36b0-ffde-4047-9ddd-9c9b7edd30c3 tempest-ProjectReaderTests-573287655 None] Created volume successfully. Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Acquiring lock "cinder-708c8340-3938-4ea5-98d8-e2cb43798a67-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Lock "cinder-708c8340-3938-4ea5-98d8-e2cb43798a67-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-16fb6d0f-65de-475d-b5c4-852c42de6e44-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-16fb6d0f-65de-475d-b5c4-852c42de6e44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-e4030d70-44f9-4151-8352-05df023f0029" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Acquiring lock "cinder-quobyte-708c8340-3938-4ea5-98d8-e2cb43798a67" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-e4030d70-44f9-4151-8352-05df023f0029" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-16fb6d0f-65de-475d-b5c4-852c42de6e44" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Lock "cinder-quobyte-708c8340-3938-4ea5-98d8-e2cb43798a67" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-16fb6d0f-65de-475d-b5c4-852c42de6e44" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Deleting offline snapshot 16fb6d0f-65de-475d-b5c4-852c42de6e44 of volume e4030d70-44f9-4151-8352-05df023f0029 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] snapshot_file for this snap is: volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[de218461-8b90-490c-888d-1bcb38ba0c07]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24959dc-e035-41e8-a461-84539edfb88f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:00 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 1073741824" returned: 0 in 0.545s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:00 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:00 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 Sep 11 21:44:00 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:00 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67 Sep 11 21:44:00 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:00 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 Sep 11 21:44:00 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:01 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" returned: 0 in 0.278s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9eadab6-e83a-4f15-8ab9-fe981d4b0ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d10fc4-1bf4-457b-8e59-20025b7fcb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:01 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Volume volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 (64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6): created successfully Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d10fc4-1bf4-457b-8e59-20025b7fcb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (11681d55-6438-42dc-8a1b-03636d4e94ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:01 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67" returned: 0 in 0.391s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:01 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44" returned: 0 in 0.401s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4030d70-44f9-4151-8352-05df023f0029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:44:01 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67 Sep 11 21:44:01 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d43a9e07-1e68-4fcd-8f36-ac55e6ae98ab tempest-ProjectMemberTests-1173642712 None] Created volume successfully. Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d61fbd-c9d5-4c06-8935-8ac5c1ab859b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:01 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 Sep 11 21:44:01 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:01 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-708c8340-3938-4ea5-98d8-e2cb43798a67" returned: 0 in 0.255s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Lock "cinder-quobyte-708c8340-3938-4ea5-98d8-e2cb43798a67" released by "delete_volume" :: held 0.708s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Created reservations ['b757e696-3bca-462f-be48-f9866df90228', '33920742-3d28-495d-8558-fffabf944be0', '6e19c5de-d859-4c05-a5c9-2f11c6c1727d', '37b3bd45-a6ee-496d-aca9-a390375a52e7'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:01 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029" returned: 0 in 0.361s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:01 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:01 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:01 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 Sep 11 21:44:01 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:01 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.272s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:01 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Deleted volume successfully. Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-1666f146-207d-4bda-b216-c27f648a4cac tempest-ProjectReaderTests-573287655 None] Lock "cinder-708c8340-3938-4ea5-98d8-e2cb43798a67-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:01 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44" returned: 0 in 0.425s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:01 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44 Sep 11 21:44:01 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:01 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Creating offline snapshot 3b44a9d0-014e-4cd4-af5d-34d1e3d9278a of volume 64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e401a204-19c2-4dcc-86d8-bef3225b1f46]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:02 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 Sep 11 21:44:02 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:02 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029.16fb6d0f-65de-475d-b5c4-852c42de6e44" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-16fb6d0f-65de-475d-b5c4-852c42de6e44" released by "_delete_snapshot" :: held 1.579s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-e4030d70-44f9-4151-8352-05df023f0029" released by "delete_snapshot" :: held 1.613s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Created reservations ['2e3a5ce7-e4a3-4a5d-bbf2-afff837999f0', '834e21e3-5c37-4ed9-ac54-2b248b2aad23', '6b8bfb5b-6cac-4ac4-8508-61d9599486e8', '88e4559e-fe98-43ad-9a91-b69d7857be12'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:02 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Delete snapshot completed successfully. Sep 11 21:44:02 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" returned: 0 in 0.413s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-29934233-f112-43be-a33d-960a95790a24 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-16fb6d0f-65de-475d-b5c4-852c42de6e44-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:02 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a 1G Sep 11 21:44:02 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-e4030d70-44f9-4151-8352-05df023f0029-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-e4030d70-44f9-4151-8352-05df023f0029-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "cinder-quobyte-e4030d70-44f9-4151-8352-05df023f0029" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:02 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-e4030d70-44f9-4151-8352-05df023f0029" acquired by "delete_volume" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a 1G" returned: 0 in 0.511s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee20c6-9809-4ea1-9e9f-302d72387c2d]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:02 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:02 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a Sep 11 21:44:02 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:03 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 Sep 11 21:44:03 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:03 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a" returned: 0 in 0.325s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:03 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a is being set with open permissions: ugo+rw Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:03 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a Sep 11 21:44:03 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:03 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029" returned: 0 in 0.408s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:03 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029 Sep 11 21:44:03 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:03 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a" returned: 0 in 0.270s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:03 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.info Sep 11 21:44:03 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:03 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-e4030d70-44f9-4151-8352-05df023f0029" returned: 0 in 0.285s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-quobyte-e4030d70-44f9-4151-8352-05df023f0029" released by "delete_volume" :: held 0.765s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Created reservations ['65e198ed-5947-41ad-85ea-2a60dc7d1ae1', '58d928a9-63c9-4213-8340-a93e4dd1ddd2', 'ba7565c3-6684-4097-a426-fb1930deb7c0', '271416e1-71dd-4f76-a948-0893ad11990e'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:03 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:03 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:03 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.info" returned: 0 in 0.283s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:03 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.info is being set with open permissions: ugo+rw Sep 11 21:44:03 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:03 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.info Sep 11 21:44:03 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:04 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.281s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:04 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Deleted volume successfully. Sep 11 21:44:04 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-420504c9-d66f-449b-bbcf-e7b2341f1477 tempest-ProjectReaderTests-1143561272 None] Lock "cinder-e4030d70-44f9-4151-8352-05df023f0029-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:04 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.info" returned: 0 in 0.292s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:04 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:04 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-65af28c8-62dc-4731-808f-8d58ae019699 tempest-ProjectMemberTests-1173642712 None] Create snapshot completed successfully Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-3b44a9d0-014e-4cd4-af5d-34d1e3d9278a-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-3b44a9d0-014e-4cd4-af5d-34d1e3d9278a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-3b44a9d0-014e-4cd4-af5d-34d1e3d9278a" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-3b44a9d0-014e-4cd4-af5d-34d1e3d9278a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Deleting offline snapshot 3b44a9d0-014e-4cd4-af5d-34d1e3d9278a of volume 64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] snapshot_file for this snap is: volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf11df05-22ad-478e-b256-cd770af80497]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:05 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a Sep 11 21:44:05 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:05 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a" returned: 0 in 0.376s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc7f44-7dbe-4dd9-ac4d-13b447ed9e94]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:05 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 Sep 11 21:44:05 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:05 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" returned: 0 in 0.356s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:05 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:05 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a Sep 11 21:44:05 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:06 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a" returned: 0 in 0.353s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:06 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a Sep 11 21:44:06 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:06 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:06 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6.3b44a9d0-014e-4cd4-af5d-34d1e3d9278a" returned: 0 in 0.249s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-3b44a9d0-014e-4cd4-af5d-34d1e3d9278a" released by "_delete_snapshot" :: held 1.436s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" released by "delete_snapshot" :: held 1.458s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:06 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Created reservations ['9db5583e-16ea-47e8-ac5a-673f3203a699', '3fcc7296-4ee7-4bbc-acce-5f589063c846', '62717f46-6913-42c5-b38a-9a90492c6550', 'bbfb084d-ece1-493b-bf7b-b6540a84c694'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:06 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Delete snapshot completed successfully. Sep 11 21:44:06 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-d2a6c5b9-391c-48a7-b698-3dce9222aef8 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-3b44a9d0-014e-4cd4-af5d-34d1e3d9278a-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" acquired by "delete_volume" :: waited 0.023s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[878f8575-e89f-4b45-9efb-06f106c30ce3]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:07 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 Sep 11 21:44:07 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Flow 'volume_create_manager' (b2554744-ec55-48aa-83af-59804790a83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b33f598-4cb3-4661-9f45-f02aec7b7e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b33f598-4cb3-4661-9f45-f02aec7b7e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867100558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3033ef-9ccc-4c36-8888-8af324853593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283f9e4e54934391b9e0498cda15ecbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:08Z,use_quota=True,user_id='140f1a4275634e17884fdad1696ed1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36245a8b-d45e-461f-a7ef-4d5f72fa6730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36245a8b-d45e-461f-a7ef-4d5f72fa6730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8ea241-a26f-4082-b471-eb6e0ab5c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8ea241-a26f-4082-b471-eb6e0ab5c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3033ef-9ccc-4c36-8888-8af324853593', 'volume_name': 'volume-ae3033ef-9ccc-4c36-8888-8af324853593', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d354c4-5a86-4646-8905-0fb61869b800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d354c4-5a86-4646-8905-0fb61869b800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b0dd4-0514-4590-86ee-655340412809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:07 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Volume ae3033ef-9ccc-4c36-8888-8af324853593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3033ef-9ccc-4c36-8888-8af324853593', 'volume_size': 1} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867100558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3033ef-9ccc-4c36-8888-8af324853593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283f9e4e54934391b9e0498cda15ecbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:08Z,use_quota=True,user_id='140f1a4275634e17884fdad1696ed1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Creating volume ae3033ef-9ccc-4c36-8888-8af324853593 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:44:07 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:07 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593 1073741824 Sep 11 21:44:07 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:07 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:07 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:07 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6 Sep 11 21:44:07 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:08 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" returned: 0 in 0.267s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6" released by "delete_volume" :: held 0.727s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Created reservations ['bafb758e-cece-45e7-a938-ada5226085d6', '2f83e247-106a-4ae8-8265-ce4cb444f3b9', '920cbbfd-2d14-4858-b8e4-c7927f5955a6', 'a868d498-544e-405b-904c-55fe23b63236'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:08 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593 1073741824" returned: 0 in 0.482s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:08 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:08 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:08 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593 Sep 11 21:44:08 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:08 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.269s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:08 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593" returned: 0 in 0.252s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:08 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Deleted volume successfully. Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b0dd4-0514-4590-86ee-655340412809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3033ef-9ccc-4c36-8888-8af324853593', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fb4842-d059-4cc3-9cd1-9c272babaff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:08 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Volume volume-ae3033ef-9ccc-4c36-8888-8af324853593 (ae3033ef-9ccc-4c36-8888-8af324853593): created successfully Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fb4842-d059-4cc3-9cd1-9c272babaff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Flow 'volume_create_manager' (b2554744-ec55-48aa-83af-59804790a83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-dc978de1-8f23-4e55-a27b-b82a1f7fa116 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-64b21f28-6d2c-4aa4-a5d7-9b8a1c6e63e6-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:08 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-002b4d71-3eb5-4f8c-94d3-88803ea58b2e tempest-ProjectReaderTests-1609707182 None] Created volume successfully. Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (4ee0b330-d243-47a9-b9c5-1a97235f933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874c9e7a-5955-457f-923a-9134348c6fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874c9e7a-5955-457f-923a-9134348c6fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744842824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15a6d9c-4252-4abd-ad2c-70adf64d083e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:09Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6dbaa0-1da8-429d-9295-958cc1dba576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6dbaa0-1da8-429d-9295-958cc1dba576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b862d79-83e2-40ff-b64f-03c9393f5e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b862d79-83e2-40ff-b64f-03c9393f5e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15a6d9c-4252-4abd-ad2c-70adf64d083e', 'volume_name': 'volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17bfeb0-a383-44a5-9c51-6c7c718112f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17bfeb0-a383-44a5-9c51-6c7c718112f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ba6824-b6b4-4aff-baa8-88fbf119ed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:08 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Volume d15a6d9c-4252-4abd-ad2c-70adf64d083e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e', 'volume_size': 1} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744842824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15a6d9c-4252-4abd-ad2c-70adf64d083e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:09Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Creating volume d15a6d9c-4252-4abd-ad2c-70adf64d083e {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:44:08 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:44:08 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:08 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e 1073741824 Sep 11 21:44:08 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:09 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e 1073741824" returned: 0 in 0.399s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:09 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e Sep 11 21:44:09 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:09 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e" returned: 0 in 0.244s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ba6824-b6b4-4aff-baa8-88fbf119ed78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac548f2-2604-4745-9cf8-1360353b10b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:09 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Volume volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e (d15a6d9c-4252-4abd-ad2c-70adf64d083e): created successfully Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac548f2-2604-4745-9cf8-1360353b10b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (4ee0b330-d243-47a9-b9c5-1a97235f933f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:09 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-723bee90-e2a7-4bba-b3e2-4e122008a6ca tempest-ProjectMemberTests-1173642712 None] Created volume successfully. Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Acquiring lock "cinder-ae3033ef-9ccc-4c36-8888-8af324853593-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Lock "cinder-ae3033ef-9ccc-4c36-8888-8af324853593-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Acquiring lock "cinder-quobyte-ae3033ef-9ccc-4c36-8888-8af324853593" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Lock "cinder-quobyte-ae3033ef-9ccc-4c36-8888-8af324853593" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c66bac-47ae-4d19-b062-3e677fbe75ba]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:09 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Creating offline snapshot e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 of volume d15a6d9c-4252-4abd-ad2c-70adf64d083e {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8ec85-82ce-44ae-9f51-61e63d0a34e5]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:10 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593 Sep 11 21:44:10 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:10 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e Sep 11 21:44:10 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:10 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593" returned: 0 in 0.368s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:10 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593 Sep 11 21:44:10 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:10 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:10 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 1G Sep 11 21:44:10 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:10 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-ae3033ef-9ccc-4c36-8888-8af324853593" returned: 0 in 0.236s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Lock "cinder-quobyte-ae3033ef-9ccc-4c36-8888-8af324853593" released by "delete_volume" :: held 0.647s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Created reservations ['516e95f0-6376-4a81-b8bf-eb2b1ac339cb', '3c3f2be4-7c5a-4d65-9070-be57994974cb', 'b27f7f7c-5745-488e-ab12-f7f1dae35bdd', 'ae27d6c6-2d64-440f-8690-c2861625d965'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:10 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:10 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:10 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 1G" returned: 0 in 0.442s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:10 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:10 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 Sep 11 21:44:10 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:11 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.286s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:11 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Deleted volume successfully. Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-b59fac5a-9bee-4717-90f0-a688c328f28c tempest-ProjectReaderTests-1609707182 None] Lock "cinder-ae3033ef-9ccc-4c36-8888-8af324853593-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:11 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43" returned: 0 in 0.334s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:11 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 is being set with open permissions: ugo+rw Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:11 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 Sep 11 21:44:11 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:11 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43" returned: 0 in 0.256s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:11 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.info Sep 11 21:44:11 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Flow 'volume_create_manager' (24986627-9a91-4c7f-8220-ecdfa1dee15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9b79b3-bf82-432b-9f60-0b10280c00c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9b79b3-bf82-432b-9f60-0b10280c00c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892263682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e7b64b-b5c6-42d0-922a-7d689ce55131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283f9e4e54934391b9e0498cda15ecbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:12Z,use_quota=True,user_id='140f1a4275634e17884fdad1696ed1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfdb945-47c7-4cbc-b3c4-12745fd90b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfdb945-47c7-4cbc-b3c4-12745fd90b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d00ec19-0856-4f1b-91db-489f9a21e460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d00ec19-0856-4f1b-91db-489f9a21e460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e7b64b-b5c6-42d0-922a-7d689ce55131', 'volume_name': 'volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffe62fc-6fe7-47dd-9118-a55857987f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffe62fc-6fe7-47dd-9118-a55857987f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aabe82f-f4b8-42c2-bc7e-dbb2131794e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:11 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Volume f3e7b64b-b5c6-42d0-922a-7d689ce55131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131', 'volume_size': 1} Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:11 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.info" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:11 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.info is being set with open permissions: ugo+rw Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:11 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.info Sep 11 21:44:11 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:11 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:11 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.info" returned: 0 in 0.236s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892263682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e7b64b-b5c6-42d0-922a-7d689ce55131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283f9e4e54934391b9e0498cda15ecbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:12Z,use_quota=True,user_id='140f1a4275634e17884fdad1696ed1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Creating volume f3e7b64b-b5c6-42d0-922a-7d689ce55131 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:44:12 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:12 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 1073741824 Sep 11 21:44:12 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d028bbc5-1b9e-4acf-827d-b3297868cc10 tempest-ProjectMemberTests-1173642712 None] Create snapshot completed successfully Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Lock "cinder-e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-d15a6d9c-4252-4abd-ad2c-70adf64d083e" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-d15a6d9c-4252-4abd-ad2c-70adf64d083e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Deleting offline snapshot e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 of volume d15a6d9c-4252-4abd-ad2c-70adf64d083e {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] snapshot_file for this snap is: volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36b24dc-767d-4c77-a164-cde34842a329]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:12 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 Sep 11 21:44:12 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:12 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 1073741824" returned: 0 in 0.408s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:12 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 Sep 11 21:44:12 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:12 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43" returned: 0 in 0.394s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[2239d8cf-a6f3-437e-9179-60de6bc532d1]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:12 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131" returned: 0 in 0.261s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aabe82f-f4b8-42c2-bc7e-dbb2131794e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0aac5d6-7826-4074-acb5-b9b2cfa93a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:12 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Volume volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 (f3e7b64b-b5c6-42d0-922a-7d689ce55131): created successfully Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0aac5d6-7826-4074-acb5-b9b2cfa93a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:12 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Flow 'volume_create_manager' (24986627-9a91-4c7f-8220-ecdfa1dee15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:12 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-2df98ba0-c35e-482b-8a48-6463a9e16cb7 tempest-ProjectReaderTests-1609707182 None] Created volume successfully. Sep 11 21:44:12 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e Sep 11 21:44:12 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:13 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e" returned: 0 in 0.368s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:13 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 Sep 11 21:44:13 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:13 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43" returned: 0 in 0.317s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:13 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43 Sep 11 21:44:13 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:13 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e.e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43" returned: 0 in 0.265s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Acquiring lock "cinder-f3e7b64b-b5c6-42d0-922a-7d689ce55131-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43" released by "_delete_snapshot" :: held 1.450s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-d15a6d9c-4252-4abd-ad2c-70adf64d083e" released by "delete_snapshot" :: held 1.482s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Lock "cinder-f3e7b64b-b5c6-42d0-922a-7d689ce55131-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Acquiring lock "cinder-quobyte-f3e7b64b-b5c6-42d0-922a-7d689ce55131" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Lock "cinder-quobyte-f3e7b64b-b5c6-42d0-922a-7d689ce55131" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Created reservations ['a7a82262-3a70-4b49-b398-ad124e2d2076', 'ae9ad158-0b50-4e92-8cd4-3a73b009b608', '1c87864c-b98c-4940-a10e-e59c32ed9171', 'f844f42c-58ec-45bd-9bbe-cf673330c5b7'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[234f36cd-3ec3-4c3c-b05e-a248f5978a02]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:13 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Delete snapshot completed successfully. Sep 11 21:44:13 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-70eaae8f-a9ea-4d0d-a6c2-5a74284480ac tempest-ProjectMemberTests-1173642712 None] Lock "cinder-e6e8329a-dfc4-4d72-a4ee-a9a2ad230e43-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:13 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 Sep 11 21:44:13 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:14 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131" returned: 0 in 0.355s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:14 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131 Sep 11 21:44:14 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-d15a6d9c-4252-4abd-ad2c-70adf64d083e-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-d15a6d9c-4252-4abd-ad2c-70adf64d083e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-d15a6d9c-4252-4abd-ad2c-70adf64d083e" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-d15a6d9c-4252-4abd-ad2c-70adf64d083e" acquired by "delete_volume" :: waited 0.025s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:14 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f3e7b64b-b5c6-42d0-922a-7d689ce55131" returned: 0 in 0.281s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Lock "cinder-quobyte-f3e7b64b-b5c6-42d0-922a-7d689ce55131" released by "delete_volume" :: held 0.674s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa1ee04-8e0c-4af2-870a-41bbab947acd]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Created reservations ['314b9ffd-1ecf-46bf-ae8a-eeaf389b148e', '0e28446b-db53-482b-a07f-b7c73d4dcb2e', 'fb3acb26-be40-4a15-bb98-acc9bec644b5', '9e08a5a9-e275-4466-8b0c-10fe7e65a753'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:14 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e Sep 11 21:44:14 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:14 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:14 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:14 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e" returned: 0 in 0.377s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:14 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.273s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:14 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Deleted volume successfully. Sep 11 21:44:14 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e Sep 11 21:44:14 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:14 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-c62617ca-c903-484e-9a1a-dba6ea67262a tempest-ProjectReaderTests-1609707182 None] Lock "cinder-f3e7b64b-b5c6-42d0-922a-7d689ce55131-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:15 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-d15a6d9c-4252-4abd-ad2c-70adf64d083e" returned: 0 in 0.291s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-d15a6d9c-4252-4abd-ad2c-70adf64d083e" released by "delete_volume" :: held 0.730s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Created reservations ['3812a43b-a2c2-44cb-ac9f-0ce80607ab39', 'd8e7c197-cb8d-4351-aa98-21fd1bf53e05', 'a2ae2422-d972-4929-b545-358bb617bec5', '2ec9bf38-d5bd-4a2b-bee0-9d0f3eb44664'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:15 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:15 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:15 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.256s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:15 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Deleted volume successfully. Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-6552c84d-7a3b-47ae-a333-662c32af89d5 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-d15a6d9c-4252-4abd-ad2c-70adf64d083e-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:15 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:15 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:16 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.289s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (929bf6cd-cc89-47f4-b6d8-ffee64125a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e2d293-fdc4-4fc1-9081-8390ff9840af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e2d293-fdc4-4fc1-9081-8390ff9840af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890676792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37799d9-c6c5-4772-9b39-b9fb6cad9471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:16Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a3b6c0-e00a-4f68-8088-5a9d60cef2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a3b6c0-e00a-4f68-8088-5a9d60cef2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8531a6bd-a33a-4492-a470-bac083256e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8531a6bd-a33a-4492-a470-bac083256e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37799d9-c6c5-4772-9b39-b9fb6cad9471', 'volume_name': 'volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b66ded-74bf-4491-a927-530dd3c05fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b66ded-74bf-4491-a927-530dd3c05fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510449f0-9fe3-4618-a954-fb501887bef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:16 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Volume f37799d9-c6c5-4772-9b39-b9fb6cad9471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471', 'volume_size': 1} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890676792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37799d9-c6c5-4772-9b39-b9fb6cad9471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:16Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Creating volume f37799d9-c6c5-4772-9b39-b9fb6cad9471 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:44:16 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:16 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 1073741824 Sep 11 21:44:16 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:16 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 1073741824" returned: 0 in 0.476s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:16 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 Sep 11 21:44:16 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:16 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510449f0-9fe3-4618-a954-fb501887bef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6a8b12-f639-4c79-ae8e-33caf5e4016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:16 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Volume volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 (f37799d9-c6c5-4772-9b39-b9fb6cad9471): created successfully Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6a8b12-f639-4c79-ae8e-33caf5e4016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (929bf6cd-cc89-47f4-b6d8-ffee64125a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d6dad7bf-62e0-416d-aff8-a88d08d77e24 tempest-ProjectMemberTests-1173642712 None] Created volume successfully. Sep 11 21:44:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Creating offline snapshot 3eafd44c-67f3-4dcd-b91d-caafc1128312 of volume f37799d9-c6c5-4772-9b39-b9fb6cad9471 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:44:18 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a7446b-2d2c-4478-99cc-9c8d2781ca4c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:18 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 Sep 11 21:44:18 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:18 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471" returned: 0 in 0.334s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:18 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 1G Sep 11 21:44:18 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:18 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 1G" returned: 0 in 0.368s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:19 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 Sep 11 21:44:19 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:19 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312" returned: 0 in 0.271s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:19 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 is being set with open permissions: ugo+rw Sep 11 21:44:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:19 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 Sep 11 21:44:19 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:19 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312" returned: 0 in 0.241s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:19 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.info Sep 11 21:44:19 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:19 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.info" returned: 0 in 0.239s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:19 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.info is being set with open permissions: ugo+rw Sep 11 21:44:19 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:19 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.info Sep 11 21:44:19 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:19 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.info" returned: 0 in 0.230s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.757s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:20 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-efa12c8f-67fc-484e-8afb-5318499ec379 tempest-ProjectMemberTests-1173642712 None] Create snapshot completed successfully Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-3eafd44c-67f3-4dcd-b91d-caafc1128312-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Lock "cinder-3eafd44c-67f3-4dcd-b91d-caafc1128312-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-f37799d9-c6c5-4772-9b39-b9fb6cad9471" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-f37799d9-c6c5-4772-9b39-b9fb6cad9471" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-3eafd44c-67f3-4dcd-b91d-caafc1128312" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-3eafd44c-67f3-4dcd-b91d-caafc1128312" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Deleting offline snapshot 3eafd44c-67f3-4dcd-b91d-caafc1128312 of volume f37799d9-c6c5-4772-9b39-b9fb6cad9471 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] snapshot_file for this snap is: volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[4568c3b6-fa48-4997-ad91-bfc1a674988c]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:20 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 Sep 11 21:44:20 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:20 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312" returned: 0 in 0.347s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[baae1f49-8e74-4d7f-9600-f17262debbe9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:20 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:20 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 Sep 11 21:44:20 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:21 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471" returned: 0 in 0.340s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:21 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 Sep 11 21:44:21 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:21 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312" returned: 0 in 0.321s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:21 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312 Sep 11 21:44:21 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:21 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:21 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471.3eafd44c-67f3-4dcd-b91d-caafc1128312" returned: 0 in 0.238s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-3eafd44c-67f3-4dcd-b91d-caafc1128312" released by "_delete_snapshot" :: held 1.329s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-f37799d9-c6c5-4772-9b39-b9fb6cad9471" released by "delete_snapshot" :: held 1.350s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:21 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Created reservations ['356eee31-a20f-4b35-87f7-a6d784caf0ee', 'e81b87e2-8a1d-4d36-8bf5-192137fbae62', 'da093d32-5887-49ce-9354-c102030af71d', '3a1d5964-d590-44ef-a2e8-9f6754faaf44'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:21 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Delete snapshot completed successfully. Sep 11 21:44:21 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-e10c1935-cead-4f7e-8667-dddf6be4275e tempest-ProjectMemberTests-1173642712 None] Lock "cinder-3eafd44c-67f3-4dcd-b91d-caafc1128312-delete_snapshot" released by "delete_snapshot" :: held 1.472s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-f37799d9-c6c5-4772-9b39-b9fb6cad9471-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-f37799d9-c6c5-4772-9b39-b9fb6cad9471-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-f37799d9-c6c5-4772-9b39-b9fb6cad9471" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-f37799d9-c6c5-4772-9b39-b9fb6cad9471" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:22 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[3142d353-5750-4348-a95f-c8b42bd4b793]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:22 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 Sep 11 21:44:22 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:22 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471" returned: 0 in 0.346s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:22 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471 Sep 11 21:44:22 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:23 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-f37799d9-c6c5-4772-9b39-b9fb6cad9471" returned: 0 in 0.235s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-f37799d9-c6c5-4772-9b39-b9fb6cad9471" released by "delete_volume" :: held 0.632s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Created reservations ['3f7d0741-7d6a-4a4e-add7-0f065c26af9e', '0d227dc7-3707-4f3c-8b7e-194d922101f6', '82f97910-6fe0-404d-a037-74996cb68c5d', '19386122-d4bb-41a4-8a0b-d4fb04d8f1e8'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:23 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:23 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:23 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.234s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:23 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Deleted volume successfully. Sep 11 21:44:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-911b0b8e-e415-4c33-9393-ed485f7ad757 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-f37799d9-c6c5-4772-9b39-b9fb6cad9471-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (bd55d627-872d-484b-810c-ecdf16b098a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3cd27a-5b72-44a0-94ff-e90a4584848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3cd27a-5b72-44a0-94ff-e90a4584848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521213587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e87960-33c2-4a5b-885c-639c238255fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:24Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c686ec-c8da-4179-a0c6-d19ed14c958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c686ec-c8da-4179-a0c6-d19ed14c958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cebe45c-dd30-4526-b0d6-d5f4bb69108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cebe45c-dd30-4526-b0d6-d5f4bb69108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e87960-33c2-4a5b-885c-639c238255fb', 'volume_name': 'volume-95e87960-33c2-4a5b-885c-639c238255fb', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf6160e-b02b-4905-b5ce-f91a65a6485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf6160e-b02b-4905-b5ce-f91a65a6485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29c8f6d-6487-4275-87a9-ed413f3811d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:24 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Volume 95e87960-33c2-4a5b-885c-639c238255fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e87960-33c2-4a5b-885c-639c238255fb', 'volume_size': 1} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521213587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e87960-33c2-4a5b-885c-639c238255fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:24Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Creating volume 95e87960-33c2-4a5b-885c-639c238255fb {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:44:24 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:24 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb 1073741824 Sep 11 21:44:24 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:24 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb 1073741824" returned: 0 in 0.386s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:DELETE=22,cinder:UPDATE=249,cinder:INSERT=71,cinder:SELECT=209 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:24 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb Sep 11 21:44:24 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:24 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb" returned: 0 in 0.241s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29c8f6d-6487-4275-87a9-ed413f3811d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e87960-33c2-4a5b-885c-639c238255fb', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a117807-44d4-45a6-a31d-d365c0563d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:24 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Volume volume-95e87960-33c2-4a5b-885c-639c238255fb (95e87960-33c2-4a5b-885c-639c238255fb): created successfully Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a117807-44d4-45a6-a31d-d365c0563d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:24 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (bd55d627-872d-484b-810c-ecdf16b098a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:24 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-d6db475f-b013-4221-8f73-1f8eb5cf46d3 tempest-ProjectMemberTests-1173642712 None] Created volume successfully. Sep 11 21:44:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Creating offline snapshot d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 of volume 95e87960-33c2-4a5b-885c-639c238255fb {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:44:25 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb5be72-cd52-4869-a256-7725f096afd9]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:25 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb Sep 11 21:44:25 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:25 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb" returned: 0 in 0.349s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:25 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 1G Sep 11 21:44:25 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:26 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 1G" returned: 0 in 0.399s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95e87960-33c2-4a5b-885c-639c238255fb -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:26 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95e87960-33c2-4a5b-885c-639c238255fb -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 Sep 11 21:44:26 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:26 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95e87960-33c2-4a5b-885c-639c238255fb -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5" returned: 0 in 0.280s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:26 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 is being set with open permissions: ugo+rw Sep 11 21:44:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:26 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 Sep 11 21:44:26 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:26 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5" returned: 0 in 0.230s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:26 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.info Sep 11 21:44:26 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:26 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.info" returned: 0 in 0.244s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:26 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.info is being set with open permissions: ugo+rw Sep 11 21:44:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:26 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.info Sep 11 21:44:26 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:27 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.info" returned: 0 in 0.234s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:27 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f8a935e1-9f2a-49d1-9670-e88133f8076c tempest-ProjectMemberTests-1173642712 None] Create snapshot completed successfully Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-d375fa7f-9878-4fb7-bd82-1aac8bfce9c5-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-d375fa7f-9878-4fb7-bd82-1aac8bfce9c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-95e87960-33c2-4a5b-885c-639c238255fb" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-95e87960-33c2-4a5b-885c-639c238255fb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-d375fa7f-9878-4fb7-bd82-1aac8bfce9c5" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-d375fa7f-9878-4fb7-bd82-1aac8bfce9c5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Deleting offline snapshot d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 of volume 95e87960-33c2-4a5b-885c-639c238255fb {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] snapshot_file for this snap is: volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26b6da-2678-46d1-b118-a536540aabb6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:27 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 Sep 11 21:44:27 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:27 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5" returned: 0 in 0.335s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95e87960-33c2-4a5b-885c-639c238255fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb2bb9a-c9ef-4491-a230-79ce31f61054]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:27 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb Sep 11 21:44:27 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:28 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb" returned: 0 in 0.367s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:28 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 Sep 11 21:44:28 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:28 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5" returned: 0 in 0.341s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:28 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5 Sep 11 21:44:28 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:28 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:28 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb.d375fa7f-9878-4fb7-bd82-1aac8bfce9c5" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-d375fa7f-9878-4fb7-bd82-1aac8bfce9c5" released by "_delete_snapshot" :: held 1.374s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-95e87960-33c2-4a5b-885c-639c238255fb" released by "delete_snapshot" :: held 1.395s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:28 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Created reservations ['660df9d9-0a2c-43df-9208-381a31358185', '0682b217-865c-4305-937c-8306c3d169cd', '0a4bb2bb-3771-4a15-bedc-f17a1fc3b525', '8bbee177-bf23-47f5-8ba5-f2053f698987'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:28 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Delete snapshot completed successfully. Sep 11 21:44:28 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-16e53b09-21fd-410b-915f-8dc256939ac2 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-d375fa7f-9878-4fb7-bd82-1aac8bfce9c5-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-95e87960-33c2-4a5b-885c-639c238255fb-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-95e87960-33c2-4a5b-885c-639c238255fb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-95e87960-33c2-4a5b-885c-639c238255fb" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:29 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-95e87960-33c2-4a5b-885c-639c238255fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:29 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f929eb-0637-4fc2-bf59-a4c5c9fce236]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:29 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb Sep 11 21:44:29 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:29 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb" returned: 0 in 0.343s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:29 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:29 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb Sep 11 21:44:29 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:30 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-95e87960-33c2-4a5b-885c-639c238255fb" returned: 0 in 0.236s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-95e87960-33c2-4a5b-885c-639c238255fb" released by "delete_volume" :: held 0.629s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Created reservations ['94347d9e-fcbe-4d31-8573-c7f0f8331066', '7f97dae2-9125-4f39-8da5-6f49c1d5b658', '4f9409a8-ff13-4834-9b2b-49f10c0a805c', '52f24fa6-2904-4639-a715-be221d574d91'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:30 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:30 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:30 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:30 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Deleted volume successfully. Sep 11 21:44:30 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-75b92d8d-fa54-4794-9e41-a3d863c63326 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-95e87960-33c2-4a5b-885c-639c238255fb-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (fa3286ae-0899-4705-8f84-c8c691df395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016018ac-b020-41b6-9610-732e558e670b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016018ac-b020-41b6-9610-732e558e670b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678992557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fb1b8c-82aa-445a-8514-80c345be73b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:31Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e4ea54-30b8-449e-bf3f-63bb37ba25db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e4ea54-30b8-449e-bf3f-63bb37ba25db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbec89b-e257-499b-9841-1c24d8402e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbec89b-e257-499b-9841-1c24d8402e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fb1b8c-82aa-445a-8514-80c345be73b3', 'volume_name': 'volume-99fb1b8c-82aa-445a-8514-80c345be73b3', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50024d9a-5eef-45ce-8007-82642e0ae55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50024d9a-5eef-45ce-8007-82642e0ae55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff7bd17-ea1b-4a61-ac92-607d4c0e0731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:31 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Volume 99fb1b8c-82aa-445a-8514-80c345be73b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fb1b8c-82aa-445a-8514-80c345be73b3', 'volume_size': 1} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678992557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fb1b8c-82aa-445a-8514-80c345be73b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:31Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Creating volume 99fb1b8c-82aa-445a-8514-80c345be73b3 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:44:31 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:31 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 1073741824 Sep 11 21:44:31 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:31 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 1073741824" returned: 0 in 0.379s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:31 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 Sep 11 21:44:31 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:31 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff7bd17-ea1b-4a61-ac92-607d4c0e0731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fb1b8c-82aa-445a-8514-80c345be73b3', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5bd4fd-e4ec-44c2-8636-d2f1aa581dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:31 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Volume volume-99fb1b8c-82aa-445a-8514-80c345be73b3 (99fb1b8c-82aa-445a-8514-80c345be73b3): created successfully Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5bd4fd-e4ec-44c2-8636-d2f1aa581dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:31 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (fa3286ae-0899-4705-8f84-c8c691df395b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:31 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-b7e595e7-058e-4844-9e13-cbefe140c32c tempest-ProjectMemberTests-1173642712 None] Created volume successfully. Sep 11 21:44:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:32 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Creating offline snapshot 9b713e92-9a84-4af2-857e-60607e1f5e39 of volume 99fb1b8c-82aa-445a-8514-80c345be73b3 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:44:32 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[33af12fe-bb5c-4c3a-b7a4-9497d23227e6]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:32 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 Sep 11 21:44:32 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:32 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3" returned: 0 in 0.355s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:32 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:32 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 1G Sep 11 21:44:32 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:33 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 1G" returned: 0 in 0.380s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fb1b8c-82aa-445a-8514-80c345be73b3 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:33 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fb1b8c-82aa-445a-8514-80c345be73b3 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 Sep 11 21:44:33 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:33 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fb1b8c-82aa-445a-8514-80c345be73b3 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39" returned: 0 in 0.290s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:33 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 is being set with open permissions: ugo+rw Sep 11 21:44:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:33 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 Sep 11 21:44:33 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:33 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39" returned: 0 in 0.226s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:33 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:INSERT=71,cinder:SELECT=177,cinder:UPDATE=256,cinder:DELETE=21 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:44:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:33 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.info Sep 11 21:44:33 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:33 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.info" returned: 0 in 0.237s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:33 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.info is being set with open permissions: ugo+rw Sep 11 21:44:33 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:33 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.info Sep 11 21:44:33 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:34 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.info" returned: 0 in 0.233s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.795s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:34 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-18b75c20-e952-4cb9-814f-1e7543ffc12c tempest-ProjectMemberTests-1173642712 None] Create snapshot completed successfully Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-9b713e92-9a84-4af2-857e-60607e1f5e39-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-9b713e92-9a84-4af2-857e-60607e1f5e39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-99fb1b8c-82aa-445a-8514-80c345be73b3" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-99fb1b8c-82aa-445a-8514-80c345be73b3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-9b713e92-9a84-4af2-857e-60607e1f5e39" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-9b713e92-9a84-4af2-857e-60607e1f5e39" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Deleting offline snapshot 9b713e92-9a84-4af2-857e-60607e1f5e39 of volume 99fb1b8c-82aa-445a-8514-80c345be73b3 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] snapshot_file for this snap is: volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5677463-de7f-4e31-9d9f-b1865eec79c2]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:34 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 Sep 11 21:44:34 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:34 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39" returned: 0 in 0.335s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99fb1b8c-82aa-445a-8514-80c345be73b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[011f1b5c-868e-4af5-88ac-4cc695ac3825]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:34 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:34 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 Sep 11 21:44:34 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:35 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3" returned: 0 in 0.338s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:35 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 Sep 11 21:44:35 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:35 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39" returned: 0 in 0.321s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:35 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39 Sep 11 21:44:35 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:35 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:35 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3.9b713e92-9a84-4af2-857e-60607e1f5e39" returned: 0 in 0.242s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-9b713e92-9a84-4af2-857e-60607e1f5e39" released by "_delete_snapshot" :: held 1.316s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-99fb1b8c-82aa-445a-8514-80c345be73b3" released by "delete_snapshot" :: held 1.334s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:35 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Created reservations ['4d151e55-6fab-4813-bf0c-88a16a57ff83', '94966b77-66b8-4a8d-bc11-08009bbe5054', '01621faf-58d2-40c5-b70d-b836050af6a9', '328fbd4c-b253-4935-b48d-4c0046caf421'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:35 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Delete snapshot completed successfully. Sep 11 21:44:35 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-900078bf-9baf-4b0f-bebb-6cc7d53481c9 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-9b713e92-9a84-4af2-857e-60607e1f5e39-delete_snapshot" released by "delete_snapshot" :: held 1.457s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-99fb1b8c-82aa-445a-8514-80c345be73b3-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-99fb1b8c-82aa-445a-8514-80c345be73b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-99fb1b8c-82aa-445a-8514-80c345be73b3" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:36 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-99fb1b8c-82aa-445a-8514-80c345be73b3" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:36 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[1351c48a-5390-4d4d-9793-8773aeee8e35]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:36 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 Sep 11 21:44:36 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:36 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3" returned: 0 in 0.334s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:36 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:36 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3 Sep 11 21:44:36 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:37 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-99fb1b8c-82aa-445a-8514-80c345be73b3" returned: 0 in 0.229s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-99fb1b8c-82aa-445a-8514-80c345be73b3" released by "delete_volume" :: held 0.613s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Created reservations ['ab774aa1-0a79-473e-bbbb-6f2f885cf40f', '85a69b52-8244-4090-9e52-59aa926a157d', '7a61ed1a-cdb7-4a69-825e-599e06b87eb4', '024e151d-d7ee-4c15-982f-03edeb55d3b4'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:37 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:37 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:37 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.230s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:37 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Deleted volume successfully. Sep 11 21:44:37 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-15b536bb-15a6-4450-b28f-2150e656f02b tempest-ProjectMemberTests-1173642712 None] Lock "cinder-99fb1b8c-82aa-445a-8514-80c345be73b3-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (bdff0190-6f42-4727-a069-5d9d29c6288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c95711-adba-415a-86ec-12789f69d455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c95711-adba-415a-86ec-12789f69d455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711908625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30efed70-7f12-4a79-a1c3-37ce12b12411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:38Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ff3df8-5046-4e98-a267-8f747bf814d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ff3df8-5046-4e98-a267-8f747bf814d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d498fa12-6274-4896-a206-87d7899cb8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d498fa12-6274-4896-a206-87d7899cb8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30efed70-7f12-4a79-a1c3-37ce12b12411', 'volume_name': 'volume-30efed70-7f12-4a79-a1c3-37ce12b12411', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa77247f-64bd-48bb-b3dc-7cd8dc7f9519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa77247f-64bd-48bb-b3dc-7cd8dc7f9519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83abd32-0c0a-4b2c-920a-9570c84c1d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:38 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Volume 30efed70-7f12-4a79-a1c3-37ce12b12411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30efed70-7f12-4a79-a1c3-37ce12b12411', 'volume_size': 1} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711908625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30efed70-7f12-4a79-a1c3-37ce12b12411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b24e965c205499da612c174ceaabf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:44:38Z,use_quota=True,user_id='dfa68fad66fd43ddbfb4d11da200033c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Creating volume 30efed70-7f12-4a79-a1c3-37ce12b12411 {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:44:38 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:38 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 1073741824 Sep 11 21:44:38 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:38 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 1073741824" returned: 0 in 0.391s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:38 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 Sep 11 21:44:38 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:38 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411" returned: 0 in 0.242s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83abd32-0c0a-4b2c-920a-9570c84c1d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30efed70-7f12-4a79-a1c3-37ce12b12411', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c21571-c1c6-4381-a8aa-0ae4cc4e60ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:44:38 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Volume volume-30efed70-7f12-4a79-a1c3-37ce12b12411 (30efed70-7f12-4a79-a1c3-37ce12b12411): created successfully Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c21571-c1c6-4381-a8aa-0ae4cc4e60ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:44:38 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Flow 'volume_create_manager' (bdff0190-6f42-4727-a069-5d9d29c6288f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:44:38 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-39f637b9-78b0-4169-a508-0dfbda43094b tempest-ProjectMemberTests-1173642712 None] Created volume successfully. Sep 11 21:44:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:39 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Creating offline snapshot 6e0ba560-9c89-4df1-be89-50f34f53c0a3 of volume 30efed70-7f12-4a79-a1c3-37ce12b12411 {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:44:39 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e82b79-006b-4eed-85ac-8096a3fe8141]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:39 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 Sep 11 21:44:39 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:39 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411" returned: 0 in 0.342s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:39 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:39 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 1G Sep 11 21:44:39 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:40 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 1G" returned: 0 in 0.391s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30efed70-7f12-4a79-a1c3-37ce12b12411 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:40 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30efed70-7f12-4a79-a1c3-37ce12b12411 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 Sep 11 21:44:40 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:40 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30efed70-7f12-4a79-a1c3-37ce12b12411 -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3" returned: 0 in 0.293s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:40 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 is being set with open permissions: ugo+rw Sep 11 21:44:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:40 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 Sep 11 21:44:40 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:40 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3" returned: 0 in 0.242s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:40 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.info Sep 11 21:44:40 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:40 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.info" returned: 0 in 0.257s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:40 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.info is being set with open permissions: ugo+rw Sep 11 21:44:40 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:40 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.info Sep 11 21:44:40 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:41 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.info" returned: 0 in 0.235s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:41 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-19228a33-aa63-4086-96dc-341dc5dbf8e9 tempest-ProjectMemberTests-1173642712 None] Create snapshot completed successfully Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-6e0ba560-9c89-4df1-be89-50f34f53c0a3-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-6e0ba560-9c89-4df1-be89-50f34f53c0a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-30efed70-7f12-4a79-a1c3-37ce12b12411" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-30efed70-7f12-4a79-a1c3-37ce12b12411" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-6e0ba560-9c89-4df1-be89-50f34f53c0a3" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-6e0ba560-9c89-4df1-be89-50f34f53c0a3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Deleting offline snapshot 6e0ba560-9c89-4df1-be89-50f34f53c0a3 of volume 30efed70-7f12-4a79-a1c3-37ce12b12411 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] snapshot_file for this snap is: volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e2f23d-b4ae-47f3-ad20-74be05aa85bc]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:41 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 Sep 11 21:44:41 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:41 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3" returned: 0 in 0.338s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30efed70-7f12-4a79-a1c3-37ce12b12411(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca905013-7ac5-4f1f-a684-79a0ca3656ae]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:41 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:42 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 Sep 11 21:44:42 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:42 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411" returned: 0 in 0.344s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:42 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 Sep 11 21:44:42 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:42 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3" returned: 0 in 0.316s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:42 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3 Sep 11 21:44:42 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:42 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:42 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411.6e0ba560-9c89-4df1-be89-50f34f53c0a3" returned: 0 in 0.237s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-6e0ba560-9c89-4df1-be89-50f34f53c0a3" released by "_delete_snapshot" :: held 1.317s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-30efed70-7f12-4a79-a1c3-37ce12b12411" released by "delete_snapshot" :: held 1.337s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:42 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Created reservations ['39c40f43-7e49-4554-a4da-ab388c9093b2', '580c57c8-0d4b-4ff8-947b-effafb97c655', '3b0c9232-cf27-4ea6-adc7-e1261506d8d3', '1cca28e3-bf5d-4dcd-813d-9a5f56313213'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:42 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Delete snapshot completed successfully. Sep 11 21:44:42 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-8cf2df23-f76d-4673-b825-3fcb5145b263 tempest-ProjectMemberTests-1173642712 None] Lock "cinder-6e0ba560-9c89-4df1-be89-50f34f53c0a3-delete_snapshot" released by "delete_snapshot" :: held 1.465s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-30efed70-7f12-4a79-a1c3-37ce12b12411-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-30efed70-7f12-4a79-a1c3-37ce12b12411-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Acquiring lock "cinder-quobyte-30efed70-7f12-4a79-a1c3-37ce12b12411" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:44:43 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-30efed70-7f12-4a79-a1c3-37ce12b12411" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:44:43 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86162fa-88fb-4af5-af9a-e4c5b41f86fa]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:44:43 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:43 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 Sep 11 21:44:43 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:44 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411" returned: 0 in 0.348s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:44 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411 Sep 11 21:44:44 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:44 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-30efed70-7f12-4a79-a1c3-37ce12b12411" returned: 0 in 0.230s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-quobyte-30efed70-7f12-4a79-a1c3-37ce12b12411" released by "delete_volume" :: held 0.627s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Created reservations ['a1aef232-5053-497d-a17c-536a29554cae', 'c8ba4076-544e-4487-aca3-ad86767ad43f', '7d438028-2f5c-4f87-b106-43d01b537f77', '4a367169-96b4-4737-bc11-2c0287e3500b'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:44:44 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:44:44 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:44:44 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.255s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:44:44 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Deleted volume successfully. Sep 11 21:44:44 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-7a6f2b7e-118b-4774-966a-a2ae47a82f1f tempest-ProjectMemberTests-1173642712 None] Lock "cinder-30efed70-7f12-4a79-a1c3-37ce12b12411-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:44:54 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=54,cinder:SELECT=41,cinder:DELETE=4,cinder:INSERT=14 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:44:54 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=25,cinder:DELETE=3,cinder:INSERT=10,cinder:UPDATE=32 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Flow 'volume_create_manager' (af369a9f-2373-44db-b615-c82042a4d01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b92549-5045-4f7a-9b25-2c8e9dcb69c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b92549-5045-4f7a-9b25-2c8e9dcb69c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1245024803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7487d03b-eb19-42b5-9720-fada5d2af87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5432ce2f2f994b28a7ac7d79cd11d9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:45:13Z,use_quota=True,user_id='144c3d86f17242d497dbab5905970784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c8da20-c5aa-4314-a085-5ca9548f9c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c8da20-c5aa-4314-a085-5ca9548f9c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409564cf-32c8-4ae1-bd7a-44ba38c8b6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409564cf-32c8-4ae1-bd7a-44ba38c8b6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7487d03b-eb19-42b5-9720-fada5d2af87f', 'volume_name': 'volume-7487d03b-eb19-42b5-9720-fada5d2af87f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d69d2cf-bc34-4a72-8f4d-a575fa4e6208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d69d2cf-bc34-4a72-8f4d-a575fa4e6208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a576cf-3a50-46d5-8f2e-d0e82bfed1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:13 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Volume 7487d03b-eb19-42b5-9720-fada5d2af87f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7487d03b-eb19-42b5-9720-fada5d2af87f', 'volume_size': 1} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1245024803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7487d03b-eb19-42b5-9720-fada5d2af87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5432ce2f2f994b28a7ac7d79cd11d9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:45:13Z,use_quota=True,user_id='144c3d86f17242d497dbab5905970784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)}" {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Creating volume 7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:45:13 devstack cinder-volume[87423]: INFO cinder.volume.drivers.remotefs [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] casted to osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 Sep 11 21:45:13 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f 1073741824 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:13 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f 1073741824 Sep 11 21:45:13 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:14 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f 1073741824" returned: 0 in 0.404s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:14 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f Sep 11 21:45:14 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:14 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f" returned: 0 in 0.238s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'} {{(pid=87423) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a576cf-3a50-46d5-8f2e-d0e82bfed1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7487d03b-eb19-42b5-9720-fada5d2af87f', 'volume_size': 1}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f088b784-27a8-40b3-8c0a-25d9f668b3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:14 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Volume volume-7487d03b-eb19-42b5-9720-fada5d2af87f (7487d03b-eb19-42b5-9720-fada5d2af87f): created successfully Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f088b784-27a8-40b3-8c0a-25d9f668b3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Flow 'volume_create_manager' (af369a9f-2373-44db-b615-c82042a4d01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:45:14 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-c92e914e-4bf6-4188-b630-29a6375c18b1 tempest-SnapshotDependencyTests-1908663850 None] Created volume successfully. Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Creating offline snapshot bc28bb26-faf0-4361-8936-7583c5540394 of volume 7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb3c389-d6cb-471c-8a2b-c2163a4fe528]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:45:14 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:14 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f Sep 11 21:45:14 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:15 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f" returned: 0 in 0.348s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 1G {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:15 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 1G Sep 11 21:45:15 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:15 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 1G" returned: 0 in 0.398s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7487d03b-eb19-42b5-9720-fada5d2af87f -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:15 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7487d03b-eb19-42b5-9720-fada5d2af87f -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 Sep 11 21:45:15 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:15 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:45:15 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:15 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7487d03b-eb19-42b5-9720-fada5d2af87f -F qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394" returned: 0 in 0.297s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:15 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 is being set with open permissions: ugo+rw Sep 11 21:45:15 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:15 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 Sep 11 21:45:15 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:16 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.260s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG oslo_service.periodic_task [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] Running periodic task VolumeManager._thread_info {{(pid=87423) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread count: 29 {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-a083835b-5a70-471f-b523-2c7c42638168 None None] thread info: [<_MainThread(MainThread, started 134680822214784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87423) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 21:45:16 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394" returned: 0 in 0.248s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:16 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.info Sep 11 21:45:16 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:16 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.info" returned: 0 in 0.254s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:16 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.info is being set with open permissions: ugo+rw Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.info {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:16 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.info Sep 11 21:45:16 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:16 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.info" returned: 0 in 0.236s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:16 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:45:16 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-3a87e3de-bfa7-4c8c-84dc-28a8ccae42c7 tempest-SnapshotDependencyTests-1908663850 None] Create snapshot completed successfully Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87423) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Flow 'volume_create_manager' (b6805b42-442a-42bd-bc32-af0c8c417565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78463bc-a43d-4a80-a41d-07f04c5dae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78463bc-a43d-4a80-a41d-07f04c5dae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T19:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b483a6ac-449a-414e-a0f9-59c2b97cd403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5432ce2f2f994b28a7ac7d79cd11d9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T19:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc28bb26-faf0-4361-8936-7583c5540394,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T19:45:17Z,use_quota=True,user_id='144c3d86f17242d497dbab5905970784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d70efbb-c0ad-4816-b4d6-babfb0acd5b6),volume_type_id=4d70efbb-c0ad-4816-b4d6-babfb0acd5b6)' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f55e542-b58a-4697-85f3-990459b441c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f55e542-b58a-4697-85f3-990459b441c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a344574d-cc17-428d-8832-c9223def7697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a344574d-cc17-428d-8832-c9223def7697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b483a6ac-449a-414e-a0f9-59c2b97cd403', 'volume_name': 'volume-b483a6ac-449a-414e-a0f9-59c2b97cd403', 'volume_size': 1, 'snapshot_id': 'bc28bb26-faf0-4361-8936-7583c5540394'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229f8a1e-9109-4408-857a-8fa47ece304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229f8a1e-9109-4408-857a-8fa47ece304a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c531dac-8ed6-489f-a3df-c7aed98d69d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:17 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Volume b483a6ac-449a-414e-a0f9-59c2b97cd403: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b483a6ac-449a-414e-a0f9-59c2b97cd403', 'volume_size': 1, 'snapshot_id': 'bc28bb26-faf0-4361-8936-7583c5540394'} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "cinder-quobyte-bc28bb26-faf0-4361-8936-7583c5540394-b483a6ac-449a-414e-a0f9-59c2b97cd403" by "_create_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-bc28bb26-faf0-4361-8936-7583c5540394-b483a6ac-449a-414e-a0f9-59c2b97cd403" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Creating volume b483a6ac-449a-414e-a0f9-59c2b97cd403 from snapshot bc28bb26-faf0-4361-8936-7583c5540394 {{(pid=87423) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Selected osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64 as target Quobyte volume. {{(pid=87423) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "cinder-quobyte-b483a6ac-449a-414e-a0f9-59c2b97cd403" by "_copy_volume_from_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-b483a6ac-449a-414e-a0f9-59c2b97cd403" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] snapshot: bc28bb26-faf0-4361-8936-7583c5540394, volume: b483a6ac-449a-414e-a0f9-59c2b97cd403, {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ea31b4-0865-4da7-8782-c91aa639a85f]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:17 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 Sep 11 21:45:17 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:17 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394" returned: 0 in 0.345s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7487d03b-eb19-42b5-9720-fada5d2af87f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ad1f2b-0f3a-47e2-a8d8-f73353ae99cb]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:45:17 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:18 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f Sep 11 21:45:18 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:18 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f" returned: 0 in 0.338s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 21:45:18 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Creating direct copy from snapshot {{(pid=87423) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 21:45:18 devstack cinder-volume[87423]: DEBUG cinder.utils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Path /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 not found in is_blk_device check {{(pid=87423) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 21:45:18 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:18 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 Sep 11 21:45:18 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:22 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403" returned: 0 in 3.949s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.image.image_utils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f, size 1024.00 MB, duration 3.95 sec, destination /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 {{(pid=87423) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 21:45:22 devstack cinder-volume[87423]: INFO cinder.image.image_utils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Converted 1024.00 MB image at 259.13 MB/s Sep 11 21:45:22 devstack cinder-volume[87423]: WARNING cinder.volume.drivers.remotefs [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 is being set with open permissions: ugo+rw Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:22 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 Sep 11 21:45:22 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:22 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403" returned: 0 in 0.236s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-b483a6ac-449a-414e-a0f9-59c2b97cd403" released by "_copy_volume_from_snapshot" :: held 4.945s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-bc28bb26-faf0-4361-8936-7583c5540394-b483a6ac-449a-414e-a0f9-59c2b97cd403" released by "_create_volume_from_snapshot" :: held 5.002s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.016s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c531dac-8ed6-489f-a3df-c7aed98d69d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b483a6ac-449a-414e-a0f9-59c2b97cd403', 'volume_size': 1, 'snapshot_id': 'bc28bb26-faf0-4361-8936-7583c5540394'}' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66852ebb-d3f7-493c-8adf-ae60b1cebc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 21:45:22 devstack cinder-volume[87423]: INFO cinder.volume.flows.manager.create_volume [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Volume volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 (b483a6ac-449a-414e-a0f9-59c2b97cd403): created successfully Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66852ebb-d3f7-493c-8adf-ae60b1cebc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87423) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Flow 'volume_create_manager' (b6805b42-442a-42bd-bc32-af0c8c417565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87423) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 21:45:22 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-37e911a6-1deb-460f-a6c2-0cb123c4ba3c tempest-SnapshotDependencyTests-1908663850 None] Created volume successfully. Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "cinder-bc28bb26-faf0-4361-8936-7583c5540394-delete_snapshot" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-bc28bb26-faf0-4361-8936-7583c5540394-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:45:22 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "cinder-quobyte-7487d03b-eb19-42b5-9720-fada5d2af87f" by "delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-7487d03b-eb19-42b5-9720-fada5d2af87f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "cinder-quobyte-bc28bb26-faf0-4361-8936-7583c5540394" by "_delete_snapshot" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-bc28bb26-faf0-4361-8936-7583c5540394" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Deleting offline snapshot bc28bb26-faf0-4361-8936-7583c5540394 of volume 7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] snapshot_file for this snap is: volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 {{(pid=87423) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[883aa826-fae6-4740-b8d7-c4c18cd19e0b]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:23 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 Sep 11 21:45:23 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:23 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394" returned: 0 in 0.348s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.remotefs [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7487d03b-eb19-42b5-9720-fada5d2af87f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87423) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f41c0e-2832-4924-a630-dc35a5de22d0]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:23 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f Sep 11 21:45:23 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:23 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f" returned: 0 in 0.517s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:23 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:23 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 Sep 11 21:45:23 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:24 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394" returned: 0 in 0.315s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:24 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394 Sep 11 21:45:24 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:24 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:24 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f.bc28bb26-faf0-4361-8936-7583c5540394" returned: 0 in 0.247s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-bc28bb26-faf0-4361-8936-7583c5540394" released by "_delete_snapshot" :: held 1.511s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:45:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-7487d03b-eb19-42b5-9720-fada5d2af87f" released by "delete_snapshot" :: held 1.535s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:45:24 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Created reservations ['671455c4-1468-4324-ab6b-0f2be1b3da07', 'b5610de4-3b8c-4a20-9d9e-97299ece45bb', 'a91d1178-8a14-4c61-b487-72230c500320', '3da263ec-c0c4-443b-af50-b3dee07fe0f5'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:45:24 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Delete snapshot completed successfully. Sep 11 21:45:24 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-a9731c7e-c11f-4f07-9496-8cf16a22927d tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-bc28bb26-faf0-4361-8936-7583c5540394-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "cinder-7487d03b-eb19-42b5-9720-fada5d2af87f-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-7487d03b-eb19-42b5-9720-fada5d2af87f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "cinder-quobyte-7487d03b-eb19-42b5-9720-fada5d2af87f" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-7487d03b-eb19-42b5-9720-fada5d2af87f" acquired by "delete_volume" :: waited 0.017s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc4d996-33d3-4dd8-a017-b6091d2978ff]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:25 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f Sep 11 21:45:25 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:25 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f" returned: 0 in 0.344s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:25 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f Sep 11 21:45:25 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:25 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-7487d03b-eb19-42b5-9720-fada5d2af87f" returned: 0 in 0.234s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-7487d03b-eb19-42b5-9720-fada5d2af87f" released by "delete_volume" :: held 0.633s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Created reservations ['fdd39c55-226f-49eb-af62-b4e9650debcb', '1e84e27f-9c84-48bd-adf7-dca8364ebcf3', 'e3f4d58b-2f0c-4f42-8f72-3fb462a12913', '7f6606f8-72b1-46f6-8d91-17d6f2769088'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:45:25 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:25 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:45:25 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:26 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.233s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:45:26 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Deleted volume successfully. Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-f948d8d8-eadf-4ffa-8ff5-089b589fb037 tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-7487d03b-eb19-42b5-9720-fada5d2af87f-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "cinder-b483a6ac-449a-414e-a0f9-59c2b97cd403-delete_volume" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-b483a6ac-449a-414e-a0f9-59c2b97cd403-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "cinder-quobyte-b483a6ac-449a-414e-a0f9-59c2b97cd403" by "delete_volume" {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-b483a6ac-449a-414e-a0f9-59c2b97cd403" acquired by "delete_volume" :: waited 0.014s {{(pid=87423) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90b3368-5d95-4b41-87f8-21aa7faae4d1]: (4, 'qcow2') {{(pid=88056) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:26 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 Sep 11 21:45:26 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:26 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403" returned: 0 in 0.339s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:26 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403 Sep 11 21:45:26 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:26 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:26 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b/volume-b483a6ac-449a-414e-a0f9-59c2b97cd403" returned: 0 in 0.240s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-quobyte-b483a6ac-449a-414e-a0f9-59c2b97cd403" released by "delete_volume" :: held 0.622s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG cinder.quota [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Created reservations ['b66d471c-c031-4e88-a9be-663abd48c25a', 'e495c4ac-f7a1-4273-8d9c-727092119ab1', 'bbf95aad-244a-4a0e-9b03-756b93eaa322', '3e6384e8-e8aa-4060-8b75-312f7445f895'] {{(pid=87423) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64': None} {{(pid=87423) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG cinder.volume.drivers.quobyte [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dcfe3fbd-28fb-49b4-a23c-7b08e0dbfb64'] {{(pid=87423) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.lockutils [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87423) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 21:45:27 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b Sep 11 21:45:27 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 21:45:27 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG oslo_concurrency.processutils [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f09adfee6cb411c6168bd9c233a399b" returned: 0 in 0.241s {{(pid=87423) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG cinder.manager [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Notifying Schedulers of capabilities ... {{(pid=87423) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 21:45:27 devstack cinder-volume[87423]: INFO cinder.volume.manager [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Deleted volume successfully. Sep 11 21:45:27 devstack cinder-volume[87423]: DEBUG cinder.coordination [None req-659dba13-868e-4465-ac05-1f133246e581 tempest-SnapshotDependencyTests-1908663850 None] Lock "cinder-b483a6ac-449a-414e-a0f9-59c2b97cd403-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87423) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 21:45:37 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:SELECT=27,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 21:45:37 devstack cinder-volume[87423]: DEBUG dbcounter [-] [87423] Writing DB stats cinder:UPDATE=33,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87423) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}